

,¶
* Department of Pediatrics, University of Colorado Health Sciences Center, and the Children's Outcomes Research Program, Children's Hospital, Denver, Colorado
Colorado Health Outcomes Program
Department of Preventive Medicine and Biometrics
¶ Division of General Internal Medicine, University of Colorado Health Sciences Center, Denver, Colorado
|| Health Advocates, Denver, Colorado
| ABSTRACT |
|---|
|
|
|---|
Methods. We interviewed 480 randomly selected families by telephone 2 months after their first enrollment into CHP+ (September 1999 to January 2000) and, again, 1 year later. We used generalized linear models to examine the effect of enrollment on health care access, utilization, and quality while controlling for type of previous insurance, length of time uninsured before enrollment, race/ethnicity, and age.
Results. Regarding access to care, the percentage of families who reported a usual site of preventive care did not change significantly, but families reported more often being able to see providers as soon as desired for routine care (incidence ratio [IR]: 2.03; 95% confidence interval [CI]: 1.373.02]), for care when sick or injured (IR: 2.77; 95% CI: 1.854.16), for specialty care (IR: 1.96; 95% CI: 1.163.32), and for all health care (IR: 2.35; 95% CI: 1.813.07). Unmet medical needs decreased after versus before enrollment for prescription medications (IR: 0.38; 95% CI: 0.260.55), mental health care (IR: 0.63; 95% CI: 0.400.97), prescription glasses (IR: 0.44; 95% CI: 0.290.65), and dental care (IR: 0.59; 95% CI: 0.470.76). Regarding utilization, the proportion who saw a provider for routine care in the past year increased (IR: 1.39; 95% CI: 1.061.83), but reported visits for sick, specialty, and emergency department care and hospitalizations did not increase. Regarding quality of care, the proportion who rated their health care as "best" increased (RI: 1.31; 95% CI: 1.041.66) after versus before enrollment.
Conclusions. Families who were newly enrolled into CHP+ perceived dramatic increases in access to all types of care and decreases in unmet medical needs, no increase in utilization of emergency department or hospitalization services, and improved overall quality of care in the year after enrollment into CHP+.
Key Words: SCHIP access to health care health insurance quality of health care
Abbreviations: SCHIP, State Children's Health Insurance Program CHP+, Child Health Plan Plus FPL, federal poverty level
In response to the growing problem of uninsured children, the Balanced Budget Act of 1997 created the State Children's Health Insurance Program (SCHIP), providing federal funding to help states expand the provision of health insurance to uninsured low-income children. Currently, 20 states have stand-alone, non-Medicaid SCHIP programs, 14 have Medicaid expansion programs, and 17 are operating programs that are combinations of both types of plans.1 Although enrollment in the first few years was slower than hoped,24 by June 2002, it had reached 3.6 million nationally.5,6 Recently, there is also encouraging evidence that SCHIP is making a difference in levels of uninsured children. Cunningham,7 using data from the Community Tracking Study household survey, demonstrated that almost 20% fewer children were uninsured in 20002001 than in 19981999 nationally. In addition, Elixhauser et al8, using data from the Medical Expenditure Panel Survey, demonstrated a decline in the percentage of children who were uninsured all year from 10.3% in 1996 to 7.8% in 1999.
Since the enactment of SCHIP, most of the published literature regarding the program has focused on issues of enrollment, eligibility, and retention.25,917 Because SCHIP is a relatively new program, little has been published regarding the effect of SCHIP on important processes of care measures and health outcomes. The major objectives of the present study were to compare reported access to care, utilization of health care, and overall quality of care 1 year before and during the first year after enrollment into Colorado's SCHIP, the Child Health Plan Plus (CHP+). Specifically, we addressed the following questions: Did enrollment in CHP+ increase the percentage of children with a medical home and access to preventive, acute, and subspecialty health services? Did enrollment result in higher utilization of medical services after enrollment than preceding enrollment? Did enrollment result in higher overall quality of care services from the perspective of the enrolling family?
| METHODS |
|---|
|
|
|---|
Design and Study Population
We conducted 2 telephone surveys, 1 year apart, for a cohort of families who had recently enrolled a child in CHP+ for the first time. We randomly selected families who had enrolled 2 months before and did an initial survey during September 1999 through January 2000 (N = 711). We surveyed 2 months after enrollment, because >90% of newly enrolling families have been notified of their acceptance to the program and assigned to a provider by this time. A follow-up survey was conducted 1 year later, during November 2000 through February 2001, for the same cohort. Families with both initial enrollment and 1-year follow-up surveys (N = 480) composed the study population. The study protocol was approved by the Colorado Multiple Institutional Review Board.
Survey Method
The survey instrument and method have been previously described in more detail.9 During both surveys, families were asked to report only on the year preceding the interview, corresponding to the year before and the year after enrollment into CHP+. The surveys incorporated standardized questions with minor modifications from the National Health Interview Survey Household survey, the Prototype Children's Health Insurance and Health Care Questionnaire from the State and Local Area Integrated Telephone Surveys of the National Center for Health Statistics, and the Consumer Assessment of Health Plans Child Core that have been previously used by the study team.2,9 The interviews were conducted in English or Spanish, depending on the preference of the interviewee.
Interviews were conducted by Survey Units at the Colorado Department of Public Health and Environment and the AMC Cancer Research Center in Denver, Colorado. Families were called up to 15 times at different calling periods to optimize response rates, and both home and work numbers listed with the program were used. The interview was programmed for Computer Assisted Telephone Interviewing and skip patterns and acceptable range of responses, and consistency checks were programmed into the instrument. A minimum of 10% of all interviews were monitored by supervisors who randomly listened to calls and, using Local Area Network Assist Plus software, monitored interviewers' computer screens at the monitoring station.
Definition of Measures
Measures of access to care included whether there was a usual source of care or an identified primary provider; ease in seeing provider for routine, acute, or subspecialty care (on a 4-point Likert scale); and whether there were unmet prescription, mental health, vision, dental, routine, acute, or subspecialty health care needs. Utilization of care measures included the quantity of routine, acute office, subspecialty or emergency department visits, and hospitalizations. Quality of care was determined by having parents rate the quality of health care received (10-point Likert scale with 0 = worst and 10 = best) and by assessing whether any preventive care had occurred in the previous year. Type of previous insurance was categorized as private, Medicaid, none, or other, and length of time uninsured before enrollment in CHP+ was grouped into 3 levels: no gap in insurance, uninsured <1 year, and uninsured 1 year or more. Race/ethnicity was determined by self-report and was categorized as white, black, Hispanic, or other.
Data Analysis
For bivariate analyses, binary categorical data were analyzed using McNemar's test for paired data, and continuous data were analyzed using paired t tests. In comparing access to care for subgroups who perceived a need for preventive, acute illness or injury, or subspecialty care, paired data could be statistically compared only for those who needed these types of care in both years. For multivariate analyses, binary categorical data were analyzed using logistic regression, and continuous outcomes (number of visits) were analyzed using Poisson regression within a Generalized Linear Model. For the multivariate analysis, each child contributed 2 records to the data set, 1 for the year before CHP+ enrollment and 1 for the year during CHP+ enrollment. To account for repeated measures of the same children over time, a generalized linear models analysis was used (SAS PROC GENMOD). We did multivariate modeling using 2 methods. We first ran the model including all of the explanatory variables and, subsequently, using backward elimination, including only explanatory variables that reached a significance level of .25 or less.18 Results are reported for variables with significance levels of <.05.
The dependent variables in our analyses were measures of access to care, utilization of care, and quality of care. The explanatory variables that initially were included in the models were period of measurement (pre-CHP+ enrollment vs post-CHP+ enrollment), type of previous insurance, length of time uninsured before enrollment in CHP+, and reported race/ethnicity. In addition, because age is known to be a significant predictor of utilization, we included age in years as a continuous variable measured at time of enrollment and age2 to account for a possible quadratic contribution of age. The results presented therefore are adjusted for age. We also assessed interaction terms including the pre/post time period by previous insurance and by length of time uninsured. SAS Version 8.2 (SAS Institute, Cary, NC) was used in all analyses.
| RESULTS |
|---|
|
|
|---|
Bivariate Analyses
Access to Health Care
As demonstrated in Table 1, the percentages of families who reported a usual site of preventive care or identified a primary care provider did not change for the year before and the first year after CHP+ enrollment. However, the percentage of families who reported that it was very easy or easy to get all of the health care for their child increased from 53.9% to 73.1%, a relative increase of 36%. In addition, the percentages of families who reported "usually" or "always" seeing a provider as soon as desired for routine care, for care when sick or injured, or for subspecialty care increased significantly from preenrollment to postenrollment. The absolute increases shown correspond to relative increases of 13% for routine care, 17% for sick care, and 67% for specialty care. As Fig. 1 demonstrates, there were also dramatic decreases in the percentages of families who reported being unable to obtain needed services because they could not afford them. This was particularly striking for prescription drugs, with a relative decrease of 55%, and for eyeglasses, with a relative decrease of 48%, between the preenrollment and the postenrollment years. There was also a significant decrease in reported unmet dental care, despite the fact that CHP+, during the time of this study, did not provide dental benefits. Overall, 1 year after enrollment into the program, 44% of families (n = 210) still reported some unmet health need, but only 19% of the unmet need was for services other than dental.
|
|
|
Multivariate Analyses
Results of multivariate analyses predicting change in post- versus preenrollment responses and controlling simultaneously for child's age and race, the length of time uninsured before CHP+ enrollment, and the type of previous insurance are shown in Table 3. The interaction terms assessed were not found to be meaningful and, therefore, are not included. Multivariate results were similar when all variables were included or when a backward elimination method was used. Because we were interested in reporting incidence ratios for other significant predictors of the effect of CHP+ enrollment, Table 3 shows the results of the backward elimination analyses.
|
When we ran the same multivariate model including only children who, before enrollment, had no medical home or no primary provider (n = 155), more significant changes in utilization data associated with enrollment were evident. Comparing postenrollment and preenrollment, the incidence ratio for seeing a provider for routine care in the past year increased to 2.53 (95% confidence interval: 1.564.10) and the incidence ratio for number of visits as a result of illness or injury increased to 1.48 (95% confidence interval: 1.181.87).
| DISCUSSION |
|---|
|
|
|---|
Since SCHIP's enactment in 1997, little has been published in the medical literature evaluating the effect of the program on health status, access, utilization, and quality of care. Although several studies assessed the effects of state child health plans that predated SCHIP in Colorado,19 New York,20,21 Massachusetts,22 and Florida,23,24 few data directly compare outcome measures before and after enrollment in SCHIP programs.2528 A study of the North Carolina SCHIP, a stand-alone, fee-for-service program, demonstrated increases in the percentage of children with an identified private physician or clinic and decreases in unmet medical needs for prescription medications and eyeglasses after SCHIP enrollment.27 Another study that compared health status and unmet health needs for children before and after enrollment in Kansas's SCHIP also demonstrated significant decreases in unmet need after SCHIP enrollment, as well as modest increases in the proportion of children whose health was rated as very good to excellent by their parents.25 More recently, a substantially larger and more comprehensive study of New York's SCHIP was published, using similar methods to the present study but also including a comparison group enrolled at the time of the 1-year follow-up interviews to control for secular trends.26 This study demonstrated increases in the percentage of children with a usual source of care; decreases in unmet health care needs for preventive, acute, subspecialty, dental, and vision care; and increases in the proportion of children with preventive care and in continuity of care.
The results of the current study add to the growing evidence that SCHIP has been successful in improving health care access and delivery for enrolled children. Eligible families in Colorado perceived significant barriers to access before enrollment, and CHP+ enrollment was associated with increases in access to all types of health care. The pre- versus postenrollment decreases in unmet needs for prescription drugs, vision care, routine care, and acute care were similar in magnitude in our study to the study of Szilagyi et al,26 and, as in New York, we also demonstrated significant decreases in unmet need in all categories of health care. The reductions by 50% in unmet needs for eyeglasses and for prescription drugs in the current study are particularly notable, as such changes might translate into substantial educational benefits and better management of childhood illnesses for enrolled children. Residual unmet need 1 year after enrollment overall was twice as high in Colorado (44%) than in New York (19%); however, more than half of the residual need in Colorado was related to dental needs, a service not covered by CHP+. When dental services were not included, residual unmet health needs in Colorado and New York 1 year after SCHIP enrollment were very similar. It is interesting that families in Colorado perceived a decrease in barriers to dental care after enrollment, despite that CHP+, during the time of this study, did not provide dental benefits. Although we could not find another report of this in the literature, we speculate that this perception may indicate that, as a result of coverage by CHP+, families had more of their own financial assets to put toward dental care.
Although access was reportedly much improved, the mean rates of visits of all kinds did not increase significantly after enrollment in the total cohort, although the percentage who received any preventive care increased and the number of acute illness visits increased in children who did not have a medical home at the time of enrollment. These data are also consistent with the recent data from New York's evaluation that showed increases only in preventive services, with stable utilization for emergency, acute, and subspecialty care.26 In contrast, the evaluation of Kansas's SCHIP demonstrated increases in office visits of all types.25 However, in the Kansas study, families who did not reenroll in SCHIP for a second year were excluded, perhaps resulting in retention in the sample of families who used more services. In addition, possible confounders, such as age, were not controlled for in the analyses.
The reasons for the apparent mismatch between data showing, on the one hand, uniform increases in perceived access and decreases in unmet need and, on the other hand, very modest changes in utilization are not entirely clear. Our data show that pent-up demand for routine and acute care visits was concentrated in the subgroup of children who had not had a medical home or provider at the time of CHP+ enrollment. Because this group was relatively small, their increased utilization may not have been reflected in the overall analyses. In fact, a previous study in our state demonstrated that families who enrolled in the first few years of the program, "early enrollers," were more likely to have a primary provider and less likely to have been uninsured before enrollment than eligible uninsured children who did not enroll.9 It is possible that characteristics of families enrolled at the time of the current study may have motivated them to seek health care, despite difficulties, before enrollment in CHP+, thereby blunting differences in utilization associated with enrollment. An alternative explanation, proposed by Szilagyi et al,26 is that SCHIP enrollment may result in more effective coordination of care and more efficient health care delivery as a result of increasing the proportion of care delivered at the usual site of care. In the current study, we did not collect data pertaining to the site of care for all visits and, therefore, are unable to test this plausible theory.
Our study relies on self-reported measures of access and utilization, which are subject to recall bias. However, we did compare 2 sets of data collected in the same manner and requesting recall for the same period 1 year apart. Because our conclusions are based on comparisons of these reported values rather than on absolute reported values, problems with recall bias probably do not have a large impact on our results. Findings regarding satisfaction with quality of care in the previous year may be more subject to reporting bias than other measures, because families are aware that they are being asked to assess the program. In addition, small sample sizes of children who were younger than 3 years and of children with chronic illnesses limited our ability to assess fully the impact of these subgroups on observed utilization patterns. Finally, this was an observational beforeafter study, and it is not possible, given this study design, to control for secular trends and demonstrate definitively that reported differences were attributable solely to enrollment in CHP+.
The results of this study demonstrate that families who enrolled for the first time in SCHIP in Colorado perceived dramatic increases in access to health care, decreases in financial barriers to care, and improvements in their overall quality of care. These gains were made without apparent increases in the more costly sites of health care, such as emergency department use or hospitalizations. Unfortunately, in the current climate of economic uncertainty and state fiscal downsizing, the success of CHP+ and other SCHIPs in increasing access to care may be unraveling. In November 2003, 6 states, including Colorado, implemented enrollment freezes in their SCHIPs.29 A survey of state SCHIP officials and child health advocates in these states suggests that these freezes are already resulting in tens of thousands of eligible children being turned away and are compounding inequities in insurance by income. In addition to the immediate effects of such freezes on new enrollment, already enrolled children whose families fail to comply promptly with renewal procedures will lose enrollment in these states until enrollment freezes are lifted. In the face of difficult economic times, when the need for insurance in families with low-income children is particularly high, the repercussions of enrollment freezes are likely to be dramatic. It is ironic that, at a time when SCHIP has sufficiently matured to allow us to demonstrate success in decreasing levels of uninsurance, increasing access, and improving quality of health care, the political and economic climate is such that these successes may go unheralded and may, indeed, be rapidly reversed.
| ACKNOWLEDGMENTS |
|---|
We are grateful to the Colorado Department of Health Care Policy and Financing for allowing us access to CHP+ data and for their input into the research. We also acknowledge Annie Wohlgenant, Rose Community Foundation, for help in disseminating our findings locally to those involved in influencing health policy and Barbara Stucky for help in preparing this manuscript.
| FOOTNOTES |
|---|
Reprint requests to (A.K.) Children's Hospital, 1056 E 19th Ave, B032, Denver, CO 80218. E-mail: kempe.allison{at}tchden.org
The views in this article are those of the authors and do not necessarily represent the views or policies of the Colorado Department of Health Care Policy and Financing.
No conflict of interest declared.
| REFERENCES |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
G. Flores and S. C. Tomany-Korman The Language Spoken at Home and Disparities in Medical and Dental Health, Access to Care, and Use of Services in US Children Pediatrics, June 1, 2008; 121(6): e1703 - e1714. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. E. DeVoe, A. Baez, H. Angier, L. Krois, C. Edlund, and P. A. Carney Insurance + Access != Health Care: Typology of Barriers to Health Care Access for Low-Income Families Ann. Fam. Med, November 1, 2007; 5(6): 511 - 518. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. G. Federico, J. F. Steiner, B. Beaty, L. Crane, and A. Kempe Disruptions in Insurance Coverage: Patterns and Relationship to Health Care Access, Unmet Need, and Utilization Before Enrollment in the State Children's Health Insurance Program Pediatrics, October 1, 2007; 120(4): e1009 - e1016. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. Todd, C. Armon, A. Griggs, S. Poole, and S. Berman Increased Rates of Morbidity, Mortality, and Charges for Hospitalized Children With Public or No Health Insurance as Compared With Children With Private Insurance in Colorado and the United States Pediatrics, August 1, 2006; 118(2): 577 - 585. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. F. Daley, L. A. Crane, V. Chandramouli, B. L. Beaty, J. Barrow, N. Allred, S. Berman, and A. Kempe Influenza Among Healthy Young Children: Changes in Parental Attitudes and Predictors of Immunization During the 2003 to 2004 Influenza Season Pediatrics, February 1, 2006; 117(2): e268 - e277. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. M. Davis Planning the Next Wave of SCHIP Research Pediatrics, February 1, 2005; 115(2): 492 - 494. [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||