OBJECTIVE: To examine the rates and predictors of mental health services use for a nationally representative cohort of youths who had been investigated for alleged maltreatment.
METHODS: Data came from caregiver and caseworker baseline and 18-month interviews in the second National Survey of Child and Adolescent Well-being. These interviews took place from March 2008 to September 2008 and September 2010 to March 2011. Data on family and child characteristics and service use were gathered and examined by using weighted univariate and multivariate analyses.
RESULTS: Children had numerous challenges: 61.8% had a previous report of maltreatment, 46.3% had poor socialization skills, and 23.9% had a mental health problem measured by the Child Behavior Checklist (CBCL). At baseline, 33.3% received some mental health service and this varied by age, with younger children receiving fewer services. This percentage decreased to 30.9% at the 18-month follow-up, although the youngest children had increases in services use. For younger children, race/ethnicity, out-of-home placement, chronic physical health problems, low adaptive behaviors, and CBCL scores in the clinical range were related to use. For children ≥11, out-of-home placement, high CBCL scores, and family risk factors predicted services use at 18 months.
CONCLUSIONS: Mental health services utilization increases as young children come into contact with schools and medical providers or have more intensive involvement with child welfare. Minority children receive fewer services adjusting for need. Over the 18-month follow-up, there was a decrease in service use that may be a result of the tremendous financial challenges taking place in the United States.
- CBCL —
- Child Behavior Checklist
- CI —
- confidence interval
- MH —
- mental health
- NSCAW I —
- National Survey of Child and Adolescent Well-Being I
- NSCAW II —
- National Survey of Child and Adolescent Well-Being II
- OR —
- odds ratio
- PSU —
- primary sampling unit
What’s Known on This Subject:
Children investigated for alleged maltreatment have considerable physical, mental health (MH), developmental, and educational needs and often do not receive services to address these needs. The prevalence/correlates of MH services use in the current challenging financial environment is unknown.
What This Study Adds:
This study demonstrates the importance of medical providers and schools for receipt of MH services for these children, but shows disparities in MH service use between white and nonwhite children. Unlike earlier findings, MH service use declined over the follow-up.
Since the 1970s, providers and researchers have documented high levels of unmet health needs among the 6 million children referred to child welfare agencies annually.1–17 Mental health (MH) problems are identified in 23% to 80% of children, chronic health problems in 35% to 80%, growth abnormalities in up to 43%, and educational challenges in 31% to 67%.2,3,9,11–13,15 Although these problems have long been recognized, the documentation of their MH service use and its predictors is relatively recent.18
Early information about service use came from multiple sources.18 Medicaid analyses showed that children in foster care had higher MH services use compared with other Medicaid-supported children and that usage was related to sociodemographic characteristics and physical health status.19–24 Single-site studies demonstrated that age, race/ethnicity, and need were usually positively associated with use.25–27 San Diego–based studies found that abuse type, race/ethnicity, age, and need were related to services use.28–31 These studies documented that need and non-need factors are related to use.
The National Survey of Child and Adolescent Well-being (NSCAW I) allowed the first examination of need for and use of MH services in a nationally representative sample of children investigated by child welfare agencies. Analyses showed high MH need at entrance into child welfare (47.9%) but less service use (24.4%).32 Longitudinal analyses established that age, race/ethnicity, placement type, and consistency of service use are all positively related to continued service use. Being reported to child welfare greatly increased the likelihood of receiving some type of MH services, although these services may be suboptimal.18,26,33–37
Much has changed since NSCAW I began in 1999. Professional groups concerned with the needs of vulnerable children and multidisciplinary groups of experts have continued to advocate quality standards for screening, assessment, and treatment.38 The Council on Accreditation and the Child and Family Services Reviews have mandated attention to child well-being, including assessments and services.39–41 Advocacy groups have brought class action lawsuits against child welfare systems in more than 32 states with settlements requiring that states implement actions in 30. Approximately 70% of the settlements require provision of services, including MH services.42 These pushes for additional services occurred during a period of deep economic recession. Unemployment more than doubled nationally from a low of 4.6% in 2007 to 9% in 2011, diminishing states’ tax revenues.43 States cut budgets by an average of 4% in 2009 and almost 7% in 2010.44 Since 2008, more than 45 states have reduced services including health care programs like Medicaid (31 states) and services to the disabled (29 states).45
It is unclear what the current MH services use is for children investigated by child welfare agencies, how use is related to MH needs, and whether factors previously related to use remain important. The analyses reported in this article address these issues and compare predictors of MH services use and rates of use at 18 months post baseline between NSCAW I and the second National Survey of Child and Adolescent Well-being (NSCAW II).
Design and Analytic Sample
Data came from NSCAW II, a longitudinal study of 5872 youth ages 0 to 17.5 years referred to US child welfare agencies for whom an investigation of maltreatment was completed between February 2008 and April 2009. Excluded from the study were agencies in states that required first contact of caregivers by agency staff rather than study staff.46 Initial interviews were collected within ∼4 months of completed investigations. NSCAW II, like its predecessor NSCAW I, used a national probability sampling strategy to select primary sampling units (PSUs), typically counties, from which the sample was drawn. NSCAW II used NSCAW I PSUs whenever possible. Of the 92 PSUs in NSCAW I, 71 agreed to participate in NSCAW II, and 10 additional PSUs were added to replace those not participating.
Data come from the baseline interviews completed March 2008 to September 2009 and the 18-month follow-up interviews completed September 2010 to March 2011. Analyses used data from interviews with caregivers and child welfare workers about children ≥18 months of age (n = 3084). Services use data were also gathered at the 18-month follow-up from children ≥11 years of age. NSCAW II was approved by the Research Triangle Institute’s institutional review board; present analyses of the NSCAW II de-identified data were approved by the Rady Children’s Hospital San Diego institutional review board.
Survey Design and Assessment Procedures
Analysis weights were constructed in stages corresponding to the stage of the sample design, accounting for the probability of county selection and of each child’s selection within a county. Weights were further adjusted for more or fewer population members than expected in the sampling frame, small deviations from the original plan that occurred during sampling, nonresponse patterns, and replacement PSUs. All analyses use weighting, and weighted estimates (ie, means, percentages) represent the US child welfare population.
Sociodemographics included child’s age, sex, race/ethnicity, insurance status, and placement-related information.
The Vineland Adaptive Behavior Scale Screener measures personal and social skills with 4 age-specific versions consisting of 15 items in each domain. NSCAW II includes daily living skills and socialization domains.47
Chronic conditions is a dichotomous measure indicating whether caregivers endorsed any of 9 chronic physical health problems (ie, AIDS, asthma, autism, Down syndrome, developmental delay, diabetes, cystic fibrosis, cerebral palsy, and muscular dystrophy).
Family Risk Score is constructed from caseworkers’ interviews at baseline. A cumulative risk score was based on the sum of 14 risk assessment items (scored 1 if present, 0 otherwise) that were part of the NSCAW I risk assessment.
Child Behavior Checklist (CBCL) version 1.5-5 was administered to caregivers of young children and the CBCL 6-18 was administered to caregivers of older children. The CBCL was “designed to provide standardized descriptions of behaviors rather than diagnostic inferences.” A score of ≥64 is considered clinically significant.48,49
Outcome Variable: Use of MH Services
Current caregivers detailed children’s MH services by using an adapted version of the Child and Adolescent Services Assessment,50 focusing on 3 classes of services: Specialty MH services (outpatient and inpatient), school-based services, and medical MH services.18
Children were characterized with regard to whether they had received any MH service at the time of investigation and between the baseline and 18-month interviews. At baseline, caregivers who lived with the child since birth were asked about services received “ever” and “in the last 12 months,” whereas those who lived with the child for 12 months were asked about services in the last 12 months. Caregivers who lived with a child for <12 months or those of infants <12 months of age were asked about services “since start of living arrangements” or “since birth.” The services data were augmented with reports of MH services from caseworker interviews and, at the 18-month follow-up, from interviews with children ≥11 years old. Changes in the structure of questions about services occurred in response to concerns that NSCAW I caregivers were asked to report on services use for periods when they had not been living with the child. Given differences in the services questions between NSCAW I and NSCAW II, rates of services use at baseline are not directly comparable.
Descriptive statistics summarize key variables. Models predicting MH service use employ logistic regression and were tested in stages. Except where noted, significant bivariate predictors (P < .05) were included in multivariate models. Model stages included variables related to the child and the type of maltreatment, and then the family risk score. All analyses were conducted by using SAS-Callable SUDAAN version 10.0.1 (SAS Institute Inc, Cary, NC).
One-third of the sample was 2 to 5 years old (33.7%), half was female (50.2%), just over 50% was either black (21.8%) or Hispanic (29.3%), and 72.7% was insured by Medicaid (Table 1). Most children were in their biological homes with (22.5%) or without child welfare services (64%). Only 13.5% lived in an out-of-home placement. Many lived in families experiencing considerable psychosocial risk (33.2%, 2–3 risks; 28.4%, 4 or more risks). Children were most often placed out-of-home for supervisory neglect (25%) or other types of maltreatment (35.5%), and 61.8% of these children had a previous maltreatment report. More than 20% had one of the chronic physical conditions; 36.2% scored in the moderate to severe problem range on the Vineland Daily Living Skills and 46.3% in this range for the Vineland Socialization Scale. Prevalence of elevated CBCL scores varied by age: 13.5% of 1.5- to 2-year-olds, 15.3% of >2- to 5-year-olds, 26.7% of 6- to 10-year-olds, 32.9% of 11- to 15-year-olds, and 25.5% of those ≥16 years. Overall, 23.9% of children had a CBCL score indicating a need for MH services.
At baseline, services use increased with age from 1.9% of 1.5- to 2-year-olds to 45.9% of those ≥16 years (Table 2). The increase in use for children ≥6 years was largely driven by school-based services. At the 18-month interview, use increased for the youngest children in the study population (1–5 years), but decreased for those children ≥6 years largely owing to decreases in school-based services. A lower percentage of children 1.5 to 2 years with elevated CBCL scores received services at 18 months, compared with older children, although within age groups there were no statistically significant differences between services receipt at baseline and 18 months for children with elevated CBCL scores (Fig 1).
Characteristics related to any MH services use at 18 months by age are shown in Table 3. For the youngest children, no variable was related to use. Among >2- to 5-year-olds, use was related to race/ethnicity, placement, previous reports of maltreatment, chronic physical conditions, delays on the Vineland Daily Living Skills, and elevated CBCL scores. Children with CBCL scores in the clinical range were more than twice as likely to receive an MH service (43.2% vs 16.5%, P < .01). For 6- to 10-year-olds, MH service correlates included gender, race/ethnicity, placement, maltreatment type, chronic physical conditions, delays on either Vineland domain, and elevated CBCL scores. Children with CBCL scores in the clinical range were more than twice as likely to receive an MH service (64.2% vs 26.8%, P < .001). Among 11- to 15-year-olds, MH services use was related to 4 factors: current placement, higher family risk, delays on Vineland Socialization domain, and an elevated CBCL score. Nonrelative out-of-home placement virtually ensured the receipt of MH services. For the oldest children, placement, a family with multiple psychosocial risks, and an elevated CBCL score all were related to MH service use.
Multivariable logistic regression results showed that no characteristic was associated with use in 1.5- to 2-year-olds. For children >2 to 5 years, 4 baseline factors were related to use at 18 months (Table 4): black and Hispanic children were less likely to receive services (odds ratio [OR] = 0.31; 95% confidence interval [CI] 0.14, 0.66 and OR = 0.32; 95% CI 0.12, 0.89 respectively); those placed out-of-home at baseline were more likely (OR = 1.84; 95% CI 1.07, 3.16) to receive services compared with those in home with or without child welfare services; those with chronic physical conditions were more likely to receive services (OR = 2.52; 95% CI 1.31, 4.83) and those with elevated CBCL scores were more likely to receive services (OR = 2.97; 95% CI 1.49, 5.91). Children 6 to 10 years were more likely to receive services if they were white, placed out-of-home at baseline, were originally investigated for physical or sexual abuse rather than neglect or another form of maltreatment (OR = 0.43; 95% CI 0.23,0.82 and OR = 0.43; 95% CI 0.21, 0.90 respectively), had a chronic physical condition, or an elevated CBCL score. For those 11 to 15 years, 4 characteristics were related to service use: being placed out-of-home (OR = 2.75, 95% CI 1.11, 6.83), a moderate/severe Vineland Socialization score, an elevated CBCL score (OR = 4.69; 95% CI 2.75, 7.98), and a high family risk score (risk score ≥4: OR = 2.41; 95% CI 1.31, 4.43). For children ≥16 years, placement out-of-home (OR = 3.83; 95% CI 1.10, 13.31) and high family risk were related to receipt of MH services.
The children investigated for maltreatment in the NSCAW II sample, like those in NSCAW I, face considerable challenges. Most children have had a previous report of maltreatment, and most families face multiple social stressors. Children largely remain in their homes, usually with no follow-up services. More than 20% of children in this sample have ≥1 chronic physical health condition, 36% face moderate/severe developmental challenges, and 24% may need MH services based on CBCL scores. Generally, these levels of need are similar to NSCAW I, although the lower level of MH service need as measured by the CBCL is a surprising difference from NSCAW I, the reasons for which are not entirely clear.18
As in NSCAW I, the rates of service use were largely consistent with levels of need; however, rates of service use were considerably lower than need among the youngest children51 and increased substantially between baseline and 18 months for children ages 2 to 5 years old. We suspect that involvement in other service sectors (eg, school, primary care) contributes to the substantial increases in service use rates among these children as their needs come to the attention of other care providers.18 Support for the role of alternate care providers in recognizing need is provided by the relationship of chronic physical conditions and service use among young children. The increased likelihood of contact with medical care providers because of a chronic physical condition may increase the identification of and referral for emotional and behavioral concerns. Similar identification and referral may happen as children enter school.18
For children ≥6 years, overall rates of MH services use decreased between baseline and 18 months, although more children with elevated CBCL scores at 18 months received services compared with those at study entry, suggesting better targeting of services to children with MH needs. This decrease in service use at 18 months contrasts with the NSCAW I data, where services use increased largely owing to increases in school services.18 In NSCAW I, any MH service use at 18 months by age category was as follows: 2- to 5-year-olds 28.9%, 6- to 10-year-olds 49.5%, 11+ 64.1%. It is unknown whether decreased service use at 18 months in NSCAW II is a result of changes in the services questions, differences in the services questions time frames, or the known decrease in social and medical services by states since the 2008 recession. When we examined NSCAW I school services without the 2 questions unavailable in NSCAW II, the percentage of children receiving an MH service dropped 7%, putting it closer to the rate in NSCAW II. If it is changes in the time frames for the services questions, the NSCAW I increase in service use may be a result of overreporting by caregivers who were asked to report on time periods when they were not living with the child and had no knowledge of service use. Conversely, the NSCAW II time frame changes may produce gaps in reporting periods, and social service records are often not detailed enough for caseworkers to fill in those gaps. It is also possible that the decrease in service use is real and is related to states’ curtailment of services because of budget challenges. Certainly there are data to suggest that schools underserve children with severe MH issues.52,53 Unfortunately, evaluating these possible explanations is not currently possible with NSCAW data but should be a future research focus.
Children placed out-of-home had a higher probability of use of MH services than those remaining at home. These results are consistent with analyses of NSCAW I, which established that child welfare contact acts as a gateway to MH services for children placed out-of-home, but not as strongly for the many children who remain in their homes subsequent to a maltreatment investigation.
The high rates of socialization difficulties among children in NSCAW II suggest that children from families at risk for child welfare involvement often experience emotional/behavioral and relational difficulties. Among adolescents, use of MH services is also driven by multiple family risk factors. These associations might be a result of adolescents more actively seeking to address issues that affect their own MH in complex family environments, or a result of increased help-seeking among families with more risks. Whatever the reasons, NSCAW II clearly shows an increase in the connection between MH service use and the complexity of family issues as children age.
One important non–need-related finding, also observed in NSCAW I, is the lower rate of service use among nonwhite children. Among 2- to 10-year-old children, rates of service use by children from other race/ethnic groups is significantly lower than among white children. Previous studies have documented low rates of MH and developmental service use among nonwhite children, especially during early childhood.18,29,30 Results suggest that minority group families with high risk for child welfare involvement are less likely to receive beneficial MH services during important early developmental stages.51 Whether the failure to ensure that children who need MH services get them is because of agencies not pursuing services rigorously for nonwhite children, because of nonwhite caregivers being more reluctant to seek or accept services, or because minority children are disproportionately found on child welfare caseloads and, thus, may have relatively fewer problems/require less service is unknown.51 However, that this finding has not changed since NSCAW I suggests that agencies have not attended to this well-documented issue.18 Work by Hurlburt and colleagues35 suggests that service systems can play a substantial role in minimizing such disparities, but results from NSCAW II indicate that much more remains to be done. Given the policy implications of this finding, it should be thoroughly investigated to inform the development of incentives to minimize disparities.
Results from NSCAW II highlight system-level issues related to service use. Service use for MH problems increases as young children enter school, have additional contact with medical care providers, or have more intense involvement with child welfare. Earlier work from NSCAW I identified that how service systems relate to one another is instrumental in reducing disparities in service use among minority children,35 but the finding in NSCAW II that minority children continue to receive fewer services controlling for need suggests that these service systems may not have addressed issues important for alleviating disparities. A disturbing finding is the decrease in service use at 18-month follow-up in children 6 years and older. This decrease may be a result of the tremendous financial challenges currently facing most states and warrants careful monitoring to ensure that critically needed services remain available for children at high risk.
- Accepted July 2, 2012.
- Address correspondence to Sarah McCue Horwitz, PhD, New York University Child Study Center, Department of Child and Adolescent Psychiatry, One Park Ave, 7th Floor, New York, NY 10016. E-mail:
Dr Horwitz conceptualized the study, constructed the analysis and interpreted the data, drafted the initial manuscript, reviewed and revised the manuscript, and approved the final manuscript as submitted; Dr Hurlburt conceptualized the study, assisted with the analysis and interpreted the data, reviewed and revised the manuscript, and approved the final manuscript as submitted; Dr Goldhaber-Fiebert interpreted the data, drafted portions of the initial manuscript, reviewed and revised the manuscript, and approved the final manuscript as submitted; Dr Heneghan interpreted the data, critically reviewed and revised the manuscript, and approved the final manuscript as submitted; Ms Zhang analyzed and interpreted the data, critically reviewed and revised the manuscript, and approved the final manuscript as submitted; Ms Rolls-Reutz interpreted the data, critically reviewed and revised the manuscript, and approved the final manuscript as submitted; Ms Fisher interpreted the data, critically reviewed and revised the manuscript, and approved the final manuscript as submitted; Dr. Landsverk conceptualized the study, critically revised the manuscript for important intellectual content, and approved the final manuscript as submitted; and Dr Stein interpreted the data, critically reviewed and revised the manuscript, and approved the final manuscript as submitted.
This document includes data from the NSCAW, developed under contract with the Administration on Children, Youth, and Families, US Department of Health and Human Services and the National Data Archive on Child Abuse and Neglect. We thank the National Institute of Mental Health for the support but acknowledge that the findings and conclusions presented are those of the authors and do not necessarily reflect the opinions of the National Institute of Mental Health, or the endorsement of its content by Administration on Children, Youth and Families, US Department of Health and Human Services.
FINANCIAL DISCLOSURE: The authors have indicated they have no financial relationships relevant to this article to disclose.
FUNDING: This study was supported by the National Institute of Mental Health award P30-MH074678; PI: J Landsverk. Funded by the National Institutes of Health (NIH).
- Chernoff R,
- Combs-Orme T,
- Risley-Curtiss C,
- Heisler A
- Combs-Orme T,
- Chernoff RG,
- Kager VA
- Schor EL
- Schor EL
- Szilagyi M
- US General Accounting Office
- Administration for Children and Families
- Horwitz SM,
- Hurlburt MS,
- Zhang J
- Halfon N,
- Berkowitz G,
- Klee L
- Rubin DM,
- Alessandrini EA,
- Feudtner C,
- Mandell DS,
- Localio AR,
- Hadley T
- Leslie LK,
- Hurlburt MS,
- Landsverk J,
- Rolls JA,
- Wood PA,
- Kelleher KJ
- Stahmer AC,
- Leslie LK,
- Hurlburt M,
- et al
- ↵Council on Accreditation. Accreditation standards—public agencies. 8th ed. Available at: www.coastandards.org/standards.php?navView=public. Accessed November 10, 2011
- Adoption and Safe Families Act PL 105-89. 111 S 2115, amending 42 USC §671-675, 1997
- ↵Administration for Children and Families, US Department of Health and Human Services. Procedures manual. Available at: www.acf.hhs.gov/programs/cb/cwmonitoring/tools_guide/proce_manual.htm. Accessed August 21, 2011
- ↵Kosanovich A, Joseph RM. Child welfare consent decrees: analysis of thirty-five court actions from 1995–2005. Child Welfare League of America. 2005. Available at: www.cwla.org/advocacy/consentdecrees.pdf. Accessed August 21, 2011
- ↵US Bureau of Labor Statistics. Table A-2. Employment status of the civilian noninstitutional population 16 years and over by sex, 2002 to date. Available at: www.bls.gov/web/empsit/cpseea02.pdf Accessed March 30, 2012
- ↵National Association of State Budget Officers. The fiscal survey of the states, spring 2011: a report by the National Governors Association and the National Association of State Budget Officers. Washington, DC. Available at: www.nasbo.org/sites/default/files/Spring-2011-Fiscal-Survey_0.pdf. Accessed March 30, 2012
- ↵Johnson N, Oliff P, William E. An update on state budget cuts. Washington, DC: Center on Budget and Policy Priorities. Available at: www.cbpp.org/files/3-13-08sfp.pdf. Accessed March 30, 2012
- ↵Dowd K, Donlan M, Wallin J, et al. National Survey of Child and Adolescent Well-Being II: Combined Values 1-2 Data User’s Manual Restricted Release Version. Ithaca, NY: Cornell University, National Data Archive on Child Abuse and Neglect; 2011.
- Sparrow SS,
- Carter AS,
- Cicchetti D
- ↵Achenbach TM, Rescorla AA. Manual for the ASEBA preschool forms and profiles. Available at: www.aseba.org/preschool.html. Accessed September 13, 2011
- Administration for Children and Families
- Nelson CM,
- Rutherford RB Jr,
- Center DB,
- Walker HM
- Copyright © 2012 by the American Academy of Pediatrics