OBJECTIVES: To determine the relationship of child behavioral health (BH) screening results to receipt of BH services in Massachusetts Medicaid (MassHealth) children.
METHODS: After a court decision, Massachusetts primary care providers were mandated to conduct BH screening at well-child visits and use a Current Procedural Terminology code along with a modifier indicating whether a BH need was identified. Using MassHealth claims data, a cohort of continuously enrolled (July 2007–June 2010) children was constructed. The salient visit (first use of the modifier, screening code, or claim in fiscal year 2009) was considered a reference point to examine BH history and postscreening BH services. Bivariate and multivariate logistic regression analyses were performed to determine predictors of postscreening BH services.
RESULTS: Of 261 160 children in the cohort, 45% (118 464) were screened and 37% had modifiers. Fifty-seven percent of children screening positive received postscreening BH services compared with 22% of children screening negative. However, only 30% of newly identified children received BH services. The strongest predictors of postscreening BH services for children without a BH history were being in foster care (odds ratio, 10.38; 95% confidence interval, 9.22–11.68) and having a positive modifier (odds ratio, 3.79; 95% confidence interval, 3.53–4.06).
CONCLUSIONS: Previous BH history, a positive modifier, and foster care predicted postscreening BH services. Only one-third of newly identified children received services. Thus although screening is associated with an increase in BH recognition, it may be insufficient to improve care. Additional strategies may be needed to enhance engagement in BH services.
- BH —
- behavioral health
- CBHI —
- Children’s Behavioral Health Initiative
- CPT —
- Current Procedural Terminology
- HCPC —
- Healthcare Common Procedural Code
- ICD-9-CM —
- International Classification of Diseases, Ninth Revision, Clinical Modification
- SFY —
- state fiscal year
What’s Known on This Subject:
Behavioral health (BH) screening is known to increase identification of children with BH issues, but in small-scale studies, rates of follow-up after screening have been reported to be low.
What This Study Adds:
This study examines the relationship between BH screening and the receipt of BH services in Massachusetts Medicaid children. Nearly 60% of children identified with BH problems received BH services, but only 30% of newly identified children received BH services.
Today, 1 in 5 children suffer from behavioral health (BH) problems but fewer than 30% receive treatment.1,2 BH screening in primary care is recommended as a way to identify children with BH issues and facilitate their entry into BH treatment.3,4 However, although screening has improved identification,5 thus far there has been little evidence to suggest that it leads to adequate BH treatment of newly identified issues.6
In 2008, Massachusetts implemented one of the largest enhanced children’s mental health programs in the nation, the Children’s Behavioral Health Initiative (CBHI), resulting from a court-ordered remedy for the class action suit, Rosie D versus Patrick.7 Part of the initiative mandated providers to conduct BH screening at well-child visits for all children ≤ 21 years of age who were covered by Medicaid health insurance (MassHealth). Providers could choose from an approved list of 8 validated screening tools (Supplemental Table 5).8 Screening was reimbursed and billed by using the Current Procedural Terminology (CPT) code 96110.9 In July of 2008, providers were also required to use a modifier along with the 96110 code to indicate whether a child had a BH issue identified at the screening visit although these codes were not required for reimbursement until 2011.9
Previous studies of postscreening service utilization have been limited often relying on small samples.10–12 Of the 2 articles written to date about data from CBHI, the one that explored outcomes revealed that referrals for BH services statewide in Massachusetts increased after the CBHI program was implemented13 but was cross-sectional in design and could not follow individual children to determine whether they received services. An earlier article by our group on CBHI used multiple years of data but focused on individual background features rather than outcomes.14
To date, little is known about whether children who receive screening go on to obtain specialty BH services or what predicts receipt of services. To address this research gap, the current study sought to determine whether screened children, particularly those “newly identified” as having BH issues, received BH services after their screening visits. Secondarily, we sought to identify predictors of BH service receipt among screened children.
Data were extracted from the Medicaid State Information System and covered state fiscal years (SFYs) 2008 to 2010 (July 2007–June 2010). The data set included eligibility, all encounter (managed care) and claims (fee-for-service) for physical and BH services, and pharmacy files for all children enrolled in both managed care organizations and fee-for-service arrangements. In Massachusetts, the majority of children are enrolled in 1 of 5 integrated managed care organizations, where physical and BH care are managed, or in the Primary Care Clinician program where BH is managed and physical care remains fee-for-service. Approximately 11% of children are in fee-for-service for both BH and physical care. Children with severe psychiatric disorders and those in foster care were included in the data set. However, BH services provided by non-MassHealth providers (school counselors, Department of Mental Health and Department of Children and Families staff) were not included because these services are not billed. The data were deidentified by MassHealth before delivery and unique study IDs provided. Before primary data analysis, we conducted descriptive quality assurance analyses. No significant irregularities in rates of demographic characteristics over time were found, giving us confidence in the quality of the data. This study was approved by the Cambridge Health Alliance Institutional Review Board in 2011.
For the derivation of the sample, see Fig 1. The initial sample was constructed by using SFY’09 data (1 year after the modifier scheme was mandated by MassHealth). There were 544 883 children with any enrollment in SFY’09 who were < 16 years of age. To insure continuous enrollment and our ability to capture all BH service utilization, we identified children with 300 or more days of eligibility in SFY’09. This process excluded 154 500 (28%) of children. Excluded children were significantly younger, more likely to be in foster care, and more likely to be of unknown race/ethnicity than those with ≥300 days of enrollment (P < .0001). Screens were identified by presence of a 96110 CPT code. Screens with a modifier of U1, 3, or 5 (no BH issue identified) were termed negative modifier or negative screens. Screens with a modifier of U2, 4, or 6 (BH issue identified) were termed positive modifier or positive screen for the purposes of this study. The modifier numbers signified the provider type: physician (1, 2); nurse practitioner (3, 4); and physician assistant (5, 6).
The resulting 390 383 eligible children (the characteristics of this population are described elsewhere14) were then categorized into 6 groups (Fig 1) based on their service use and BH screening in SFY’09: (1) at least 1 BH screen with a “negative” modifier but no positive modifier; (2) at least 1 BH screen with a “positive” modifier; (3) at least 1 BH screen but without any modifiers; (4) children with well-child care but no claim for a BH screen; (5) children with neither well-child visits nor BH screen claims; and (6) children with eligibility but no claims or encounters. Given the nature of the data, we cannot determine whether a screen without a modifier was positive or negative or why the modifier was missing. However, in a previous study that examined characteristics of children based on modifiers, we found that children with negative modifiers closely resembled those without modifiers.14
An index or “salient” screening visit date was assigned to children/youth based on the date of the first negative modifier (for those without positive modifiers, group 1), the first positive modifier (for group 2), and the first use of 96110 for those without any modifiers (group 3). For groups without visits including a screening claim, the first well-child visit (group 4) or the first claim/encounter (group 5) were used as the salient visits. We excluded group 6 (no claims or encounters in SFY’09) from further study since they had no “salient visit” from which to examine past utilization.
To examine services before and after the salient visit, we further limited our sample to children with at least 300 days of eligibility in each of FY’08, FY’09 and FY’10 (July 2007–June 2010). This excluded 94 330 children (27%) who were more likely to be girls, <5 years old, and of unknown race than those with 300 or more days of eligibility (P < .0001) in all 3 years. This created a group (261 160) with near-continuous enrollment and a range of 301 to 729 days of coverage before and after the salient visit. Approximately 22% to 27% of children were lost from each group defined above in this process.
The dependent variable of interest (postscreening specialty BH services) comprised the 4 categories shown in Table 2. These include the following: a psychopharmacology visit defined as a claim for psychopharmacology occurring; a psychiatric visit defined as the presence of any claim/encounter with CPT codes used by psychiatrists, psychologists, and social workers (90801–90899); and a health or behavioral assessment defined as visits with CPT codes (96100–96103, 96105, 96111, 96115–96120, 96125, 96150–96155) and nonphysician mental health visits defined as other BH professional codes (Healthcare Common Procedural Codes [HCPC H] codes). In addition, the new HCPC codes introduced in Massachusetts to track remedy services for the CBHI (S9484 and S9485, crisis intervention; and T1027, T1017, and T2022, family counseling and case management) were included. We examined visits occurring at any time after the salient visit and within 90 days of the salient visit.
Psychopharmacology agents were defined by using the HMO Research Network15 and the Mental Health Research Network16 categories for medications based on National Drug Codes. This included attention deficit disorder-other (nonstimulant medications), antidepressants, antianxiety-other (nonbenzodiazepines), anticonvulsants, antipsychotic first generation, antipsychotic second generation, benzodiazepines, COMBO (all combination psychotropic medications), hypnotic-other (eg, zolpidem), lithium, and stimulants (a full list of study medications is available upon request). Drugs with possible dual use were excluded, including the following: antidepressants used primarily for migraines and enuresis in children (imipramine, amitriptyline), antidepressants used for sleep (doxepin, trazadone) when no other psychiatric medication was being used and there was no BH International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM) code, and anticonvulsants unless accompanied by any BH ICD-9-CM code. For example, if a patient had a bipolar diagnosis on any previous visit and also used an anticonvulsant, they were included as using psychopharmacology. Medication coding was done by algorithm and by data analysts who were naïve as to screening and treatment coding.
The independent variables of interest included race/ethnicity (white, African American, Asian, Hispanic, Native American, mixed race, and unknown), urban/rural residence based on ZIP code coding from the Rural-Urban Commuting Area Codes,17 foster care, age (as categorical variables: <5, 5–7, 8–10, 11–13, 14–16), and gender.
Past BH history was defined similarly to BH services with 1 addition: the presence of any claim with a BH diagnosis (ICD-9-CM codes 290–319 on any claim) was also included in the definition.
Descriptive statistics for demographic and clinical characteristics were generated for each of the 6 groups of children by using SAS 9.3 (SAS Institute, Inc, Cary, NC).18 As the cohort was developed, sensitivity analyses were conducted to compare the sample to those children who did not meet eligibility criteria by using χ2 statistics. Intergroup differences were also assessed by using χ2 statistics and a type 1 error of 0.01.
Multivariate logistic regression was used to determine predictors of future BH treatment of all children. Given the large number of children with unknown race/ethnicity, a problem common to Medicaid claims data studies,19,20 we imputed race data for our final models by using SAS PROCMI and all available independent and dependent variables. To verify our analyses, we compared results to regression models by using race data without imputation and found similar results. Tests for interaction of variables (BH screen, past BH history, and well-child care) were also conducted. To examine predictors of future BH treatment, models were first fit for all children. In an exploratory, univariate model, BH history was found to be the strongest predictor of future treatment (odds ratio, 9.58; P < .001). We therefore assessed the interaction between key variables: BH screen modifier (positive, negative, unknown), past BH history (present or absent), and well-child visit (present or absent) in a fully saturated model. All BH history interaction terms were found to be significant (P < .001). Therefore, to enhance the interpretability of results, stratified multivariate logistic regression models were fitted: one for children with a BH history and one for those without a BH history.
There were 261 160 children with at least 300 days of enrollment in each of FY’08, FY’09, and FY’10 (see Table 1 for characteristics). Approximately half (45%) of all children in the sample were screened (n = 118 464). Approximately 19% (n = 22 714) did not have a modifier code. Of the 95 750 patients with modifier codes, 14.7% screened positive. Approximately 29% of all children had well-child visits without screens, and another 29% did not have well-child visits or screens during the index year.
Table 2 explores the differences among groups for postscreening specialty BH services. Approximately 27% of all children received some form of BH service after screening, and 98% of them received their services within 90 days after their salient visit. Children with positive modifiers were significantly more likely to receive subsequent BH services than any other group. The leading forms of services (20%) were for “psychiatry visits” (psychiatric evaluation and/or therapeutic procedures by licensed mental health professionals). The most common treatment types within these services were psychotherapy (90806) and initial evaluation (90801). Among children who received BH services, 65% had claims for psychotherapy only, 26% received a combination of psychopharmacology and psychotherapy, and 9% only had claims for psychopharmacology.
For each of the 5 screening groups, Table 3 reveals postscreening BH services for children with and without a BH history. For all BH services except psychopharmacology, children with past BH history and a positive modifier were the most likely to receive BH services. Children without BH history who either had negative modifiers or were screened without modifiers were the least likely to receive services. Children with a BH history but without well-child care or screening were significantly more likely to have claims for psychopharmacology than any other group.
Predictors of Obtaining Services
In our final models (Table 4), predictors of specialty BH services after the salient visit at any time and within 90 days were examined for all children and stratified by BH history. The second strongest predictor of services (regardless of BH history or time frame) is having a positive screening modifier, with only foster care eligibility a uniformly stronger predictor. For children without a BH history, only being in foster care was a stronger predictor of receiving future services. Among children with a BH history, in addition to foster care eligibility, older age (≥8 years) was a slightly stronger predictor of receiving services than having a positive modifier. Additionally, minority children (particularly Asians) were less likely to receive BH services than children of white race.
In this study, 45% of MassHealth children received BH screening, and 56% of those with positive modifiers received some BH services after their screening visit. Both rates represent the higher range of what has been reported elsewhere.21–24 Regardless of past BH history, a positive modifier increased the chance of receiving BH services from 10% to 30%. Only being in foster care (∼2% of the sample) was a consistently stronger predictor of receiving BH services.
The finding that BH history predicted receipt of BH services comes as no surprise. Previous research has demonstrated that children with positive modifiers are likely to have a history of BH services14 and that retrospective BH service use predicts future service use.25 In Massachusetts, providers were mandated to screen all children regardless of their history. For children with existing BH histories (for whom screening is presumably not needed), a positive screen may prompt a clinician to reevaluate symptoms and treatment recommendations.
For newly identified children, a positive screen predicted the receipt of specialty BH services. Although this is an important finding, it is also important to note that a substantial portion of these children (over 70%) still failed to receive BH services after screening. This is of concern because the positive predictive value of BH screens is ∼55%24 (the positive predictive value of the positive modifier is unfortunately unknown) and Massachusetts represents an environment with ample specialty supply. Thus the gains in specialty service use seen in this study are modest and suggest that screening alone may be insufficient to improve care. It is likely that additional services linking primary care to specialty care may be necessary to fully support entry into BH care.
Even without referral to specialty mental health, it is possible that many newly identified children had their BH needs met in primary care (eg, for attention-deficit/hyperactivity disorder treatment) as recommended by the American Academy of Pediatrics.26 To test this theory, we examined children with positive modifiers (but no billed BH services) to see if they had subsequent pediatric visits with associated BH diagnoses. In Massachusetts, primary care providers can use BH ICD-9 codes but not psychiatric CPT codes for billing. We found that an additional 394 children with a BH history and 207 children without a BH history obtained at least 1 other pediatric visit with a BH diagnosis within 180 days of their screening visits. If these were included as BH service, it would raise the rate of newly identified children receiving BH service after screening modestly from 30% to 34%, still leaving a majority of positively screened children without evidence of BH services. However, given the use of claims data, it is impossible to determine whether BH services were delivered at these visits.
The other major predictor of services in this study was being in foster care regardless of BH history. Children in foster care have been found to be at higher risk for BH issues than other children insured by Medicaid.27–32 Both their reasons for placement (eg abuse) as well as the transitions experienced while in foster care, contribute to their risk for BH issues.33,34 Additionally, the fact that they are more likely to receive specialty care is probably a function of the case management and outreach they receive as part of the foster care system. Other studies have noted that the child welfare system facilitates entry into BH treatment which was demonstrated here as well.33
Consistent with other studies, male gender and older age were predictive of future services.14,33,35–37 We also found that minority children (Hispanic, African American, and Asian) were significantly less likely to receive services after their salient visit when compared with white children despite the introduction of mandatory screening. This was particularly true for the Asian population. According to a recent Institute of Medicine Report, minority youth are less likely to receive BH services when compared with their nonminority counterparts.38 Disparities persist in BH treatment despite known high risk status39 even in children involved with the child welfare system.40 Future work is needed to better understand how mandated screening can improve engagement in BH treatment of minorities.
Lastly, it should be noted that BH services received by newly identified children were more likely to be for psychotherapy than for psychopharmacology suggesting that psychopharmacology was not the first treatment choice for these children. In contrast, children without well-child visits or screens were most likely to have claims for psychopharmacology perhaps because they had more severe psychiatric illness requiring medication but less connection to well-child care where screening occurs.41
This study was conducted by using data from the first years of implementation of BH screening mandate. The percentage of well-child visits in which screening occurred continued to climb over subsequent years of the program, exceeding 67% by the end of 2011 (over 75% for 3- to 17-year-olds). It is possible that our results would change as screening rates increased and as MassHealth improved access to BH services; however, we were unable to examine this trend given the limited time period covered by the data set. To date, there is no other state that has tracked this information for comparison, but in a previous study of a Massachusetts pediatric practice, screening rates plateaued at ∼70% to 80% after 4 years of screening.42 Some providers may not screen or bill for screening due to fears about insurance billing families, patient low literacy, unavailable translations, developmental delay,43 or missed well-child visits.
Other limitations of our study include the fact that information was unavailable on a variety of important influential demographic variables such as language of care or other social determinants of health.44 MassHealth children are likely different than commercially insured children. Moreover, the amount of “unknown” race data limits our ability to fully understand the contribution of race to our outcomes. The psychopharmacology information was limited to claims filled and did not represent prescriptions written. Also, because mental health services delivered in schools were not included in the data, we may have underestimated the amount of BH services received.
We recognize that some children lacking a BH screening CPT code may have been screened without documentation and that screens without modifiers (due to provider oversight or inconclusive results) could have been either positive or negative. Finally, by creating a sample that eliminated children who did not meet criteria, we may have introduced bias into the study even though attrition was similar across groups.
For children newly identified by BH screens, being in foster care and having a positive modifier at a screening visit are strong predictors of receiving postscreening specialty BH services. Yet, many newly identified children do not receive services and racial/ethnic disparities persist. Thus although positive screening is strongly associated with increased service use, additional strategies may be necessary to achieve the goal of connecting all children with mental health problems to needed services.
We thank Christine Payne, PhD, of the Institute for Community Health for her help with analysis and review of the article. Her skills in Medicaid claims data analysis were critically important for the study.
- Accepted June 30, 2014.
- Address correspondence to Karen A. Hacker, MD, MPH, Director, Allegheny County Health Department, 955 Rivermont Drive, Pittsburgh, PA 15207. E-mail:
Dr Hacker conceptualized the analyses, guided the analysis, and led the writing of the manuscript; Drs Penfold, Arsenault, Zhang, and Murphy provided guidance on the analysis and reviewed and edited the manuscript; Dr. Wissow provided extensive guidance on the conceptualization of the study, the analysis, and edited the manuscript; and all authors approved the final manuscript as submitted.
FINANCIAL DISCLOSURE: The authors have indicated they have no financial relationships relevant to this article to disclose.
FUNDING: All phases of this study were funded in part by grants from the Massachusetts Department of Mental Health, and from National Institute of Mental Health (NIMH) grants P20 MH086048 (to Dr. Wissow), and R21MH094942 (to Dr Hacker). Funded by the National Institutes of Health (NIH).
POTENTIAL CONFLICT OF INTEREST: The authors have indicated they have no potential conflicts of interest to disclose.
- Merikangas KR,
- He JP,
- Brody D,
- Fisher PW,
- Bourdon K,
- Koretz DS
- New Freedom Commission on Mental Health
- ↵Appendix S4: The Case for Routine Mental Health Screening. Pediatrics. 2010;125(suppl 3):S133–S139
- Simonian SJ
- National Research Council and Institute of Medicine
- ↵Rosie D; Center for Public Representation. Reforming the health care system in Massachusetts. The remedy: the pathway to home-based services. In: Center for Public Representation. Northampton, MA: Center for Public Representation; 2007
- ↵Executive Office of Health and Human Services Commonwealth of MA. The MassHealth-approved screening tools. 2012. Available at: www.mass.gov/eohhs/gov/commissions-and-initiatives/cbhi/screening-for-behavioral-health-conditions/the-masshealth-approved-screening-tools/. Accessed July 22, 2014
- ↵Executive Office of Health and Human Services Commonwealth of MA. Billing for the administration and scoring of a standardized behavioral-health screen. 2012. Available at: www.mass.gov/eohhs/gov/commissions-and-initiatives/cbhi/screening-for-behavioral-health-conditions/behavioral-health-screening-tools/billing.html. Accessed December 15, 2012
- Murphy JM,
- Arnett HL,
- Bishop SJ,
- Jellinek MS,
- Reede JY
- Hacker KA,
- Penfold R,
- Arsenault L,
- Zhang F,
- Murphy M,
- Wissow L
- ↵HMO Research Network. HMO Research Network, 2012. Available at: www.hmoresearchnetwork.org/home.htm. Accessed December 28, 2012
- ↵Mental Health Research Network. Mental Health Research Network, 2012. Available at: https://sites.google.com/a/mhresearchnetwork.org/mhrn/home. Accessed December 27, 2012
- ↵WWAMI Rural Health Research Center. Rural-urban commuting area codes (RUCAs) 2012. Available at: http://depts.washington.edu/uwruca/index.php. Accessed December 26, 2012
- ↵SAS OnlineDoc, Version 9.3 [computer program]. Cary, NC: SAS Institute Inc; 2002–2006
- Kelleher K,
- Starfield B
- Kessler R
- Foy JM,
- American Academy of Pediatrics Task Force on Mental Health
- Halfon N,
- Berkowitz G,
- Klee L
- Institute of Medicine
- Hacker KA,
- Myagmarjav E,
- Harris V,
- Suglia SF,
- Weidner D,
- Link D
- Community-University Partnership for the Study of Children Youth and Families. Review of the Ages and Stages Questionnaire: Social-Emotional (ASQ:SE). Edmonton, Alberta, Canada: Community-University Partnership for the Study of Children Youth and Families; 2011
- Minnesota Department of Health. Brief Infant Toddler Social Emotional Assessment (BITSEA) Social-Emotional Screening Instrument Profile. Developmental and Social-Emotional Screening of Young Children (0-6 years of age) in Minnesota 2013. Available at: www.health.state.mn.us/divs/fh/mch/devscrn/instr/bitsea.html. Accessed June 28, 2013
- Silver T, Schonwald A. Autism Screening Tool Kit for Primary Care Providers. 2010. Available at: http://autismscreening.org/screening_tools/index.htm. Accessed June 28, 2013
- PEDStest.com. Available at: www.pedstest.com/default.aspx. Accessed May 21, 2012
- Pediatric Symptom Checklist. 2012. Available at: www.massgeneral.org/psychiatry/services/psc_home.aspx. Accessed November 16, 2012
- Copyright © 2014 by the American Academy of Pediatrics