ARTICLE |
a Department of Pediatrics, Children's Research Institute
b Department of Population Health
c Department of Medicine, Patient Care and Outcomes Research Center
d Center for the Advancement of Underserved Children, Medical College of Wisconsin and Children's Hospital of Wisconsin, Milwaukee, Wisconsin
| ABSTRACT |
|---|
|
|
|---|
METHODS. A retrospective analysis of prospectively collected data for a cohort of children from the 2000–2001 and 2001–2002 Medical Expenditure Panel Survey panels was performed. Baseline parent-reported quality of primary care with respect to family-centeredness, timeliness, and realized access (a measure of the child's ability to receive necessary care and referrals) was assessed by using composite scores from the Consumer Assessment of Healthcare Providers and Systems survey. The primary outcomes were the numbers of subsequent nonurgent and urgent emergency department visits per child.
RESULTS. Of 8823 children included, 70.0% rated family-centeredness, 88.2% rated realized access, and 55.6% rated timeliness as high quality. After adjustment for demographic factors and health status, high-quality family-centeredness was associated with a 42% reduction in nonurgent emergency department visits for publicly insured children and a 49% reduction for children
2 years of age. Greater realized access was associated with a 44% reduction in nonurgent emergency department visits for children 3 to 11 years of age and a 56% reduction for children
12 years of age. Greater realized access was also associated with decreased nonurgent emergency department visits for publicly and privately insured children (37% and 35%, respectively). There was no significant association between timeliness and nonurgent emergency department utilization, nor was any quality-of-care domain associated with urgent emergency department utilization.
CONCLUSIONS. Parent-reported, high-quality family-centeredness and a high level of realized access to primary care were associated with decreased subsequent nonurgent emergency department visits for children. Parent reports of health care quality in these domains provide important complementary information on health care quality.
Key Words: quality of health care child utilization emergency care
Abbreviations: ED—emergency department CAHPS—Consumer Assessment of Healthcare Providers and Systems MEPS—Medical Expenditure Panel Survey IRR—incidence rate ratio CI—confidence interval
There are >25 million emergency department (ED) visits by children in the United States each year,1 with estimates of the proportion of these visits being for nonurgent conditions ranging from 37% to 60%.2–5 These nonurgent ED visits are associated with ED overcrowding,6–8 cost more than primary care provider visits,9–11 and fragment the care of children, leading to worse health outcomes.12,13 For urgent conditions, care should generally be sought in the ED; however, the large number of nonurgent ED visits is concerning, because such visits often are the result of decreased access to other sources of care.14–16
Evidence shows that there is an association between quality of primary care and ED utilization, with lower quality of care being associated with increased utilization. However, the quality of care evaluated to date focuses on processes of care,17 such as the timely receipt of immunizations or the prescribing of asthma controller medications.18–21 Although these process-of-care measures are important, we think that they fall short of a comprehensive assessment of health care quality, and we postulate that patient-reported quality domains might provide complementary information for assessment of health care quality.
Of the 6 quality-of-care domains (safety, effectiveness, patient- or family-centeredness, timeliness, efficiency, and equity) highlighted for improvement in the Institute of Medicine report Crossing the Quality Chasm,22 many are domains for which patient assessment is an important measure. The authors of the Institute of Medicine report thought that "patients' experiences should be the fundamental source of the definition of quality"23; however, patient experiences with care have largely been unexplored, in part because of the lack of means for measuring patient-reported quality of care for these domains.
The development of the Consumer Assessment of Healthcare Providers and Systems (CAHPS) (formerly the Consumer Assessment of Health Plans Study), with a parent-administered survey to evaluate quality of care for children, provides an instrument that assesses patient experiences with care validly.24 The CAHPS survey specifically addresses, from the patient or parent perspective, the family-centeredness, timeliness, and certain aspects of the effectiveness of care received from a primary care provider.25–28
The objective of the study was to determine the association between parent- reported quality of care in specific domains and subsequent ED utilization by children. We hypothesized that high-quality primary care, as indicated by parent-reported family-centeredness, timeliness, and effectiveness, would be associated with a decrease in subsequent nonurgent pediatric ED visits, without an associated decrease in urgent ED visits.
| METHODS |
|---|
|
|
|---|
Study Population
All children for whom a caregiver completed the CAHPS questions (>96% response rate32) were eligible. Children were excluded if complete follow-up information was not available for the subsequent 3 rounds of interviews; this would occur if the child left the household, was institutionalized, died, or joined the military.
Outcome Measures
The primary outcomes were the numbers of parent-reported nonurgent and urgent ED visits per child. Visit urgency was determined on the basis of the parent-reported resources used during the visit. This method of assigning urgency was used previously in large database studies and is the database research method preferred by the Ambulatory Pediatric Association Pediatric Emergency Medicine Special Interest Group.3,33,34 Exactly as in a previous study, any visit that resulted in laboratory work, a radiograph, an electrocardiogram, an electroencephalogram, or admission to the hospital was considered urgent; all others were classified as nonurgent.33 The dates for all ED visits were recorded, and only those that occurred after the date of completion of the second interview (when the CAHPS responses were collected) were included in the analysis; this ensured that all ED visits occurred after completion of the CAHPS survey.
Assessment of Health Care Quality Domains
The quality of primary care received by the child was assessed with the CAHPS questions. The 9 quality-of-care questions were grouped into composite scores for the 3 quality domains, that is, (1) family-centeredness, (2) timeliness, and (3) "realized access" to care.35 Realized access is an aspect of health care effectiveness that addresses specifically whether families perceive problems in obtaining necessary care or referrals. The individual questions constituting each composite, and their Likert scales, are listed in Table 1.
|
3.5 indicating lower-quality care.36 For realized access, scored on a 3-point Likert scale, scores were dichotomized as 3 vs <3.
Other patient/family characteristics extracted from the MEPS data set included age (categorized as 0–2 years, 3–11 years, or 12–17 years), gender, race/ethnicity (non-Latino white, Latino, non-Latino black, or other, which included Asian/Pacific Islander and Native American/Alaskan native), having a usual source of care (yes or no), having special health care needs (yes or no), interview language (English, Spanish, or both), and parent-reported child health status (excellent or very good versus good, fair, or poor). Multiple indicators of socioeconomic status were included, that is, combined annual family income categorized as a percentage of the federal poverty level and dichotomized as poor or nearly poor (<125% of the federal poverty level) versus higher than nearly poor (
125% of the federal poverty level), health insurance (public, private, or none), and the highest level of parental educational attainment (dichotomized as less than high school graduate versus high school graduate or beyond).37
Analyses
Two separate longitudinal cohorts of children were combined for the study, to provide sufficient power to allow for age and insurance subgroup analyses. The 2 cohorts included were the first 2 cohorts within MEPS to have CAHPS responses. Analyses were weighted to yield national estimates for civilian noninstitutionalized children in the United States. The "survey" commands of Stata 9.1 (Stata Corp, College Station, TX) were used for weighting the means and proportions and for the Poisson regression analyses, accounting for the nonrandom sampling strategy used in MEPS.31
Comparisons between the percentage of the population and the percentage of utilization by each demographic subgroup were made by using multiple-comparison-adjusted, survey-weighted tests. Generalized Poisson regression analyses, allowing for incorporation of an additional variance parameter to account for potential overdispersion, were used to assess the association between each composite and the number of subsequent nonurgent and urgent ED visits per child. Results from the regression analyses are presented as the incidence rate ratios (IRRs) for the number of urgent or nonurgent ED visits per child. An IRR of <1 indicates that higher quality is associated with fewer ED visits per child.
Each quality-of-care domain was analyzed in a multivariate, generalized, Poisson regression analysis with each measure of ED utilization. All covariates were entered into the model, grouped as described previously and as listed in Table 2. The groupings were derived by collapsing categories for a covariate when the relationships with ED utilization were similar. Because there were significant interactions between (1) insurance type and the composites and (2) age and the composites, stratified analyses were completed for insurance type (private insurance or public insurance) and age. The stratified regression results for children with no insurance are not presented because of small sample size.
|
| RESULTS |
|---|
|
|
|---|
The characteristics of the children and the percentages of children with
1 urgent ED visit and
1 nonurgent ED visit according to characteristic are shown in Table 2. The youngest children, for example, while constituting only 17.3% of the population, accounted for 17.9% of children making urgent ED visits but 34.8% of children making nonurgent ED visits. Therefore, the youngest children were overrepresented with respect to children making nonurgent ED visits, whereas older children were underrepresented. Children with public insurance, while constituting only 25.0% of the population, were overrepresented with respect to both urgent and nonurgent ED use, and uninsured children were underrepresented with respect to urgent ED use. Other characteristics associated with a disproportionately large number of children with nonurgent ED visits included being male, being poor/nearly poor, having special health care needs, having worse parent-reported health status, having a usual source of care, and having a lower degree of family educational attainment.
Assessment of parent-reported, quality-of-care domains showed that 70% of parents rated the family-centeredness of their child's primary care as high quality, approximately one half rated timeliness as high quality, and almost 90% rated realized access as high quality (Table 3). For both family-centeredness and realized access, high-quality care was associated with a lower number of children with
1 nonurgent ED visit. For timeliness, the percentages of children with urgent and nonurgent visits were similar, with the percentage of children with urgent visits being significantly less than the percentage reporting high-quality care.
|
To adjust for potential confounding by child and family characteristics, a multivariate, generalized, Poisson regression model was constructed. Because of significant interactions between the quality-of-care domains and both insurance type and age, the analysis was stratified according to those factors. Analysis of publicly insured children revealed that those with high-quality family-centeredness and realized access had 42% and 37% decreases in nonurgent ED visits per child, respectively (shown in Table 4 by IRRs with CIs not including 1). In contrast, high-quality timeliness was not associated with children making urgent or nonurgent visits. Among children with private insurance (Table 4), only high-quality realized access was associated with fewer nonurgent ED visits by children. High-quality care was not associated with decreased urgent ED utilization in any domain.
|
|
| DISCUSSION |
|---|
|
|
|---|
2 years of age and those with public insurance, high-quality family-centered care was associated with 40% to 50% reductions in subsequent nonurgent ED utilization, as evidenced by IRRs of 0.51 and 0.58, respectively. For older children and for children with private insurance, realized access (the ability to obtain referrals or other care that the doctor or family thought was necessary) was associated most strongly with decreased nonurgent ED visits. There were no statistically significant associations between any of the quality-of-care composites and urgent ED utilization, as evidenced by the CIs including 1.0. This lack of an association was expected, given that care for urgent conditions is less discretionary.
The association between high-quality family-centered care and nonurgent ED utilization for the youngest children and for publicly insured children is of interest. Children
2 years of age develop more acute illnesses and therefore access the health care system more frequently, for both primary care and ED visits, than do older children.38,39 When nonurgent conditions arise among these youngest children, parents who think that their children have access to high-quality family-centered care (primary care providers who respect what the parents have to say, who listen carefully, and who spend enough time with the children) may choose to have the children seen by that provider, rather than by a stranger in the ED. The content of the high-quality communication between the parents and the primary care providers may also play a role, with providers who practice family-centered care possibly explaining to families when ED care is warranted and when it is better to wait to be seen.
For children with public insurance, the issue of access to other sources of care becomes paramount. When transportation issues or financial difficulties make accessing the primary care provider more difficult, parents may use the ED for nonurgent conditions unless they perceive the loss of continuity with the primary care provider to be detrimental. The bond with the provider who delivers high-quality family-centered care may be strong enough to offset the short-term advantage of convenient ED care.
Nonurgent ED visits were less common for older children and children with private insurance than for younger children and children with public insurance. It seems that parental perceptions that the provider is not able to meet the needs of the child are more important in determining to seek ED care than the bond between the provider and the family. Whether this results from a provider actually not being able to meet the needs of the child or is simply the parent's perception of the provider's inability cannot be determined from this study. In either case, realized access was associated strongly with nonurgent utilization in these populations.
We had hypothesized that timely access to primary care would be associated with decreased nonurgent ED use, but we found no significant associations. Two explanations may be operative. First, the timeliness composite is composed of questions that assess care across many domains, including well-child care, sick care, and after-hours care, only some of which may be related to nonurgent ED utilization. Second, it may be that timely access alone is not sufficient to decrease ED utilization but the past interactions and content of previous discussions between the provider and the family dominate the family's decision to seek ED care.
The lack of an association between parent-reported quality of care and urgent ED visits also warrants exploration. As hypothesized, the quality of interactions with the primary care provider had no significant association with urgent ED visits. Studies that rely on a decrease in total ED utilization (approximately one half of which may not be discretionary) as the sole outcome may miss important reductions in nonurgent visits and may assume incorrectly that proposed interventions are not effective.
In addition to the quality domains evaluated, other covariates were associated with increased nonurgent ED visits. The findings that worse reported health status, having special health care needs, and having lower income were associated with increased ED visits are consistent with previous studies.40–42 The bivariate finding that having a usual source of care was associated with increased nonurgent ED visits is not as intuitively clear. One possible explanation is that children who lack insurance frequently lack a usual source of care; this population utilizes health care, including the ED, less frequently than do children with insurance.43 This explanation is supported by the finding that only items relating to an increased level of baseline illness (health status and special health care needs) remained significant after adjustment.
Certain study limitations should be noted. First, as with all MEPS data, the family reported the number of ED visits; there was no independent verification, which allowed for possible inaccurate reporting of data. The MEPS data, however, are collected prospectively, and the results are population based, with a large sample size. The 96% response rate for the CAHPS survey also supports the generalizability of the results. Second, the definition of urgency of ED visits was based on the resources used during the ED visit. Therefore, some visits might have been misclassified, especially those for conditions such as asthma exacerbation, for which therapeutic rather than diagnostic interventions would have resulted in classification as urgent. Classification based on resource utilization has been used in previous research, with criteria identical to those used in this study.3,33,34 Finally, we did not have a sufficient sample size for uninsured children to address adequately the association between quality of care and ED utilization in this population.
In the case of pediatric ED utilization, it is the parent who decides when and where to seek care for a child. Therefore, it is only by understanding the parent's perspective on the relationship between the family and the primary care provider that one can understand the decisions that families make when deciding where and when to seek care. The assessment of patient- or parent-reported quality of care, although not itself a comprehensive measure of health care quality, provides important complementary information about the quality of care that children receive. In addition, parent-reported quality of care in these specific domains may aid in the identification of children at increased risk for nonurgent ED visits and may allow for targeted interventions aimed at improving the care that such children receive.
| CONCLUSIONS |
|---|
|
|
|---|
| ACKNOWLEDGMENTS |
|---|
| FOOTNOTES |
|---|
Address correspondence to David C. Brousseau, MD, MS, Department of Pediatrics, Medical College of Wisconsin, CCC 550, 999 N 92nd St, Milwaukee, WI 53226. E-mail: dbrousse{at}mcw.edu
The authors have indicated they have no financial relationships relevant to this article to disclose.
| REFERENCES |
|---|
|
|
|---|
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||