Abstract
Background. The National Immunization Survey demonstrates that national immunization coverage in 2002 remained near the all-time highs achieved in 2000. However, that survey cannot detect whether coverage is uniformly high within relatively small areas or populations. The measles resurgence in the early 1990s revealed that coverage was low in some areas, particularly among inner-city children from racial and ethnic minority groups. Today, identifying areas with low childhood-vaccination coverage remains important, particularly if these areas are at risk for the introduction of disease. In 1995, the Centers for Disease Control and Prevention launched a congressionally mandated demonstrated project now called the Childhood Immunization Demonstration project of Community Health Networks. This mandate specified an assessment to determine whether a network of primary care providers affiliated with university teaching hospitals could assume a public health responsibility for raising immunization levels among preschoolers in medically underserved communities. Communities with federally designated health professional shortage areas were invited to submit proposals, and 4 were selected: Detroit, MI, New York, NY, San Diego, CA, and rural Colorado.
Objectives. To measure immunization coverage among preschool children in the 4 selected medically underserved areas and determine predictors of coverage levels.
Design and Setting. Surveys in the 4 areas were based on stratified cluster probability sample designs in which clusters of dwelling units were selected and all households in selected clusters were screened for the presence of children aged 12 to 35 months. Immunization histories were obtained from parents and providers for these children. For each age-eligible child, the information collected on utilization of immunization health services included a listing of all clinics or offices ever used for the child’s well-child care and/or for obtaining immunizations. Information was also collected on whether the child currently had health insurance (public and/or private) and whether the child had a medical home. A child was classified as having a medical home if the survey respondent reported a source of well care that was the same as the source of sick care and that this place was not an emergency department.
Participants. Children 12 to 35 months of age in Detroit, New York, San Diego, and rural Colorado.
Outcome Measure. Community-wide up-to-date (UTD) immunization coverage levels at 19 to 35 months of age, defined as receipt of 4 doses of diphtheria and tetanus toxoids and pertussis vaccine, 3 doses of poliovirus vaccine, 1 dose of measles, mumps, and rubella vaccine, 3 doses of Haemophilus influenzae type B vaccine, and 3 doses of hepatitis B vaccine (the 4:3:1:3:3 series).
Analysis. We examined the association between coverage level and independent variables and performed χ2 and t tests to determine whether differences observed within and between groups and sites were significant.
Results. The overall response rate for eligible children ranged from 79.4% to 88.1%. Coverage levels for most individual vaccines were >90% in all sites except Detroit. Coverage for the 4:3:1:3:3 series was significantly higher for children in New York (84%) and San Diego (86%) than for children in Detroit (66%) and rural Colorado (75%). Demographic risk factors related to UTD immunization status varied by site. Although differences in coverage levels by ethnicity varied by site, differences were not significant. In Colorado and New York, coverage was slightly lower among Hispanic than white children (71% vs 76% and 83% vs 91%, respectively). In San Diego, coverage was lower among whites, compared with Hispanics (76% vs 85%). Coverage was also lower for African American than white children only in New York (75% vs 91%). However, in San Diego and Colorado, children receiving their vaccinations from private providers had lower coverage levels than children receiving their vaccinations from other providers (78% vs 91% and 71% vs 57%, respectively). In all 4 sites, children for whom respondents reported having an immunization card at the time of the interview were more likely to have higher series coverage levels than children for whom a parent-held card was not available. Also, children who were UTD at 3 months of age had significantly higher vaccination-series coverage levels than children who were not UTD at 3 months of age. In addition, the vaccination coverage was lower for children in Detroit whose parents reported problems accessing the health care system because lack of transportation (46%), compared with those who did not report such problems (65%); however, this difference did not reach significance (χ2 = 6.0). In Colorado, the small proportion of children in families without a phone had a lower vaccination coverage level (58%) than those in households with a phone (75%) (χ2 = 6.3). In all sites, children who were UTD at 3 months of age and had a parent-held vaccination card were more likely to be UTD at 19 to 35 months of age.
Conclusions. Preschoolers in these medically underserved areas were not at uniform risk for underimmunization. Because they were designated as health professional shortage areas, the 4 sites in this study were expected to have low immunization-coverage rates. However, this was not the case. In fact, coverage in 3 of the 4 areas was quite high compared with US national figures (73%); only Detroit had a much lower UTD rate (66%). Efforts are needed to improve methods to identify areas with low immunization coverage so that resources can be directed to places where interventions are needed. Our results reveal that an area’s need for childhood immunization interventions is not well predicted by a low number of providers per capita. Other criteria must be developed to predict areas or populations with low immunization coverage. Understanding more about the characteristics of children/provider pairs for children who are UTD at 3 months and more about the role of parental hand-held cards, along with finding strategies to improve immunization delivery by providers in Vaccines for Children Program facilities, suggest potentially productive avenues for increasing and sustaining high coverage levels.
The National Immunization Survey demonstrates that vaccination of US preschoolers in 2001 remained near the all-time highs achieved in 2000. However, the results do not imply that coverage is uniformly high in all areas.1–3 Although incidence of vaccine-preventable diseases is low, identifying any areas with low childhood-vaccination coverage (commonly referred to as “pockets of need”) remains important. This is particularly true of urban areas, because such areas have the highest risk of transmission if disease is introduced.4 The result of low coverage among inner-city children was illustrated by the measles resurgence in the early 1990s.5,6 Of course, identifying pockets of need is a prerequisite for implementing any program designed to raise immunization coverage to assure that such a disease resurgence does not recur.
In 1995, the Centers for Disease Control and Prevention (CDC) launched a congressionally mandated demonstration project now called the Childhood Immunization Demonstration project of Community Health Networks (CHN). This mandate specified an assessment to determine whether a network of primary care providers affiliated with university teaching hospitals could assume a public health responsibility for raising immunization levels among preschoolers in medically underserved communities. Communities with federally designated health professional shortage areas (HPSAs) were invited to submit proposals, and 4 were selected: Detroit, Michigan; New York, New York; San Diego, California; and rural Colorado.
We report the results of 4 independent population-based surveys conducted by the CDC in 1997–1999 to assess baseline immunization coverage among preschool children in these 4 medically underserved areas. This is the first study to produce comparable immunization coverage estimates for several underserved communities. We also present predictors of immunization coverage levels and discuss implications for identifying pockets of need and implementing programs to raise coverage.
METHODS
Target Population
The 4 participating sites in the CHN project were designated as HPSAs5 because each area had a critical shortage of primary health care providers. HPSAs are defined as areas with a population-to-provider ratio of ≥3500 to 1, areas adjoining these underserved areas, or areas in which residents must travel >30 minutes to the nearest provider.7,8 Urban areas eligible to be considered in this project were census tracts with a population of at least 100 000 that included a designated HPSA and any contiguous census tracts in which a majority of residing children <2 years old were eligible for Medicaid. Eligible rural areas were defined as nonmetropolitan or rural areas that were beyond a metropolitan statistical area6 and in which most residents were members of traditionally underserved minority populations: African Americans, Alaska Natives, American Indians, Asian Americans, Latinos/Hispanics, and Pacific Islanders.
Household Surveys
Surveys in the 4 areas were based on stratified cluster probability sample designs in which clusters of dwelling units were selected and all households in selected clusters were screened for the presence of children 12 through 35 months old.9,10 The surveys were approved by the Institutional Review Board of the CDC in Atlanta, Georgia.
Household Interviews
Standardized interviews were conducted with primary caretakers of the age-eligible children in the sample households to obtain information on sociodemographic characteristics, utilization of immunization health services, utilization of federal programs, parental knowledge and beliefs about vaccination, and perceived barriers to accessing the immunization health care system.11–13
For each age-eligible child, the information collected on utilization of immunization health services included a listing of all clinics or offices ever used for the child’s well-child care and/or for obtaining immunizations. Information was also collected as to whether the child currently had health insurance (public and/or private) and whether the child had a medical home. A child was classified as having a medical home if the survey respondent reported a source of well care that was the same as the source of sick care and that this place was not an emergency department.
The information collected about the utilization of federal programs encompassed aid received from the US Department of Agriculture Special Supplemental Nutrition Program for Women, Infants, and Children.
The questions asked about barriers to care included availability of transportation and vaccine costs incurred by parents. Because studies of access to immunization health services have shown that up-to-date (UTD) immunization status at 3 months is a good indicator of early access to the health care system, we also constructed this indicator for use as potential predictor variable.3,5
Immunization Record
If a vaccination card was available in the home, the interviewer transcribed all immunization doses and dates to a standardized recording form. If an immunization record was not available, the interviewer completed the immunization section of the questionnaire based on the respondent’s recall. In such cases, respondents did not report specific dates for the immunizations and often responded “all shots,” or they reported that they did not know the child’s immunization history. All respondents were asked for permission to contact the child’s immunization providers. If this permission was granted, providers were sent a request for the child’s immunization record and information about the practice (including whether the facility was a Vaccines for Children Program [VFC] facility). All providers were surveyed. When 1 of a child’s providers supplied a complete record from birth, follow-up to collect data from other providers was discontinued.
Vaccination History
If a child’s parent-held records and provider records did not agree, we credited each child with all shots listed in either record. If no provider or parent-held record was available, the child’s vaccination status was classified as unknown; a report from recall was not accepted without confirmation from a provider.
Analytical and Statistical Methods
Community-wide immunization coverage levels were estimated for each area and measured as UTD for immunization at 19 to 35 months of age for comparability with the National Immunization Survey. UTD at 19 to 35 months of age was defined as receipt of 4 doses of diphtheria and tetanus toxoids and pertussis vaccine (DTP), 3 doses of poliovirus vaccine, 1 dose of measles/mumps/rubella vaccine (MMR), 3 doses of Haemophilus influenzae type b vaccine (Hib), and 3 doses of hepatitis B vaccine (HepB); these doses constitute the 4:3:1:3:3 series. We also measured UTD status for each antigen, ie, 4 doses of DTP; 3 of poliovirus vaccine, Hib, and HepB; and 1 of MMR. UTD at 3 months was defined as the receipt of 1 dose each of DTP, poliovirus vaccine, Hib, and HepB.
All estimates were weighted to represent the target populations in each of the selected sites. The weights account for unequal selection probabilities that occurred in the fieldwork in a few cases and also compensate for nonresponse by households and providers.
We assessed the UTD coverage level of children at each site separately. We examined the association between UTD coverage level and each factor and performed χ2 and t tests to determine whether differences observed within and between sites were significant. The statistical analyses accounted for the clustered sample designs. To minimize the probability of a type I error, only P values of <.01 were considered significant. Analyses were conducted by using SUDAAN, a family of statistical procedures for analysis of data from complex sample surveys.14
RESULTS
Response Rates
As shown in Table 1, 150 to 381 clusters were selected randomly in the 4 study sites, a total of 16 304 to 23 706 household units were screened in the sampled clusters in each area, and responding households yielded data for 771 to 1091 children 12 to 35 months of age. The overall enrollment response rate for eligible children ranged from 79.4% to 88.1%.
Survey Participation in the Community Health Network Study by Site
Across all 4 sites, 7% of children enrolled had no provider to contact for immunization information. The remaining children had an average of 2 providers. In total, 4905 provider questionnaires were fielded, of which 78.2% were returned. Provider reports were obtained for 88.2% of children for whom a provider was contacted.
As a result of missing hand-held records and missing provider information, immunization status was classified as unknown for some enrolled children. Table 1 shows that the overall response rate for vaccination status ranged from 70.5% to 81.5% across the 4 sites.
Population characteristics that might predispose children to have low immunization coverage varied from site to site (Table 2). Most study children in Detroit were African American, and most in New York, San Diego, and rural Colorado were Hispanic. Teen motherhood was lowest in Detroit. Maternal education was notably lower in San Diego. Most study families lived in poverty, with the exception or rural Colorado. In all sites, approximately three quarters of the families with an age-eligible child had ≥2 children.
Distribution of Population by Sociodemographic and Health Care Utilization Characteristics and Standard Errors (± SE) Among Children 12 to 35 Months Old by Site: CHN 2001
Population characteristics that enable access to health care also varied. Income was highest in Colorado. Overall, most children were insured. In Detroit, New York, and San Diego, 48% to 64% of children were privately insured, whereas in Colorado, 52% of children were insured by Medicaid or Civilian Health and Medical Program of the Uniformed Services. All study sites had an appreciable proportion of children with no insurance (7%–22%). Most of the children had been or were enrolled at the time in WIC and did not have out-of-pocket expenses for vaccinations. The vast majority of children had a medical home, and children in these communities had received immunizations from private, public, and other providers (hospital outpatient clinics and a mix of private and public providers). A majority of children in Detroit and New York had only 1 immunization provider, whereas the majority of children in Colorado and San Diego had at least 2. Overall, a large proportion of children (80%–88%) received their immunization services from providers in VFC facilities. However, 11.6% and 9.6% of children in Detroit and San Diego reported problems accessing the health care system because of transportation problems. Out-of-pocket expenses were paid for immunization services for nearly 47% of children in Colorado.
Vaccination Coverage Rates in the Study Sites
In New York and San Diego, all estimates of immunization coverage for DTP, poliovirus vaccine, Hib, and MMR among preschoolers were at least 90% (Table 3). For single antigens, coverage for 4 doses of DTP in Colorado fell below 90%. In Detroit, coverage for these antigens lagged, with coverage as low as 72% for 4 doses of DTP. Of note, the lowest coverage for HepB was 84% for Detroit, well above the goal of 70% established for the year 2000.
Up-to-Date Single Antigen and Combination Series 4:3:1:3:3 Coverage and Standard Error (± SE) Among Children 19 to 35 Months Old by Site: CHN 2001
Coverage for the 4:3:1:3:3 vaccine series (UTD at 19–35 months) was lower and varied significantly across sites (χ2 = 44.51; degrees of freedom = 3; P < .0001), with coverage in Detroit (66%) being lower than in San Diego (86%), New York (84%), and Colorado (75%).
Table 4 displays the percentage of children UTD at 19 to 35 months by selected factors. Although differences in coverage levels by ethnicity varied by site, differences were not significant. In Colorado and New York, coverage was slightly lower among Hispanic than white children (71% vs 76% and 83% vs 91%, respectively). In San Diego, coverage was lower among whites, compared with Hispanics (76% vs 85%). Coverage was also lower for African American than white children only in New York (75% vs 91%).
UTD Coverage Levels for the Combination Series 4:3:1:3:3 and Standard Errors (SE) by Population and Health Services Characteristics Among Children 19 to 35 Months Old by Site: CHN 2001
In San Diego and Colorado, vaccination coverage levels varied significantly by type of health facility. In fact, children in San Diego who received all vaccinations from a private provider had lower vaccination coverage levels than children receiving their vaccinations from the “other” category of providers (78% vs 91%; t = −3.25; P < .005); in Colorado, coverage was lower among children receiving vaccines from private providers than among children receiving vaccines from the “mixed” category of providers (71% vs 82%; t = −3.04; P < .005).
In all 4 sites, children for whom respondents reported having an immunization card at the time of the interview were more likely to have higher series coverage levels than children for whom a parent-held card was not available. Also, children who were UTD at 3 months of age had significantly higher vaccination-series coverage levels than children who were not UTD at 3 months of age. In addition, the vaccination coverage was lower for children in Detroit, whose parents reported problems accessing the health care system because lack of transportation (46%), compared with those who did not report such problems (65%); however, this difference did not reach significance (χ2 = 6.0; P = not significant). In Colorado, the small proportion of children in families without a phone had a lower vaccination coverage level (58%) than those in households with a phone (75%) (χ2 = 6.3; P = not significant).
DISCUSSION
Because they were designated as HPSAs, the 4 sites in this study were expected to have low immunization coverage rates. However, this was not the case. In fact, coverage in 3 of the 4 areas was quite high when compared with US national figures (73%)3; only Detroit had a much lower UTD rate at 66%. Efforts are needed to improve methods to identify areas with low immunization coverage so that resources can be directed to places at which interventions are needed.
Our results reveal that an area’s need for childhood immunization interventions is not well predicted by a low number of providers per capita. HPSA status may predict areas in which acute care, prenatal care, or elder care is suboptimal, but, as others have noted, HPSA criteria cannot be assumed to predict problems of access to the health care system that translate into low immunization coverage.15,16
Our findings are positive with regard to the establishment of the concept and practice of a medical home for childhood health care. In our study, >95% of children had a usual source of care, and >80% of providers participated in VFC. Moreover, being in poverty was not associated with low immunization coverage, attesting to the success of renewed emphasis on immunization (particularly infrastructure issues) that began with the Childhood Immunization Initiative.17
UTD status at 3 months and parent-held cards were shown to be strong predictors for being UTD at 19 to 35 months of age. These factors, in combination with the variation in coverage by race/ethnicity and by VFC providers practiced in VFC facilities, suggest potentially productive avenues for research. Additional studies should identify parental and provider attitudes and practices that influence immunization. Among the questions that require additional understanding are: What are the parental characteristics and behaviors that support early and sustainable linkage with the health care system? What are the provider characteristics and behaviors that motivate parents to make early and sustainable linkages with the health care system? More needs to be learned about the transactions between patient and provider as well as the environmental factors that influence quality of care that leads to early and sustainable parent-clinician relationships.
The area-sample method with household screening used here is feasible and necessary to conclusively identify pockets of underimmunization. However, better methods are needed for determining where this intensive research method may be applied most productively. We recommend that local health officials be relied on to direct research to areas that they suspect are at risk for low coverage. If local health authorities suspect low coverage in a specific population, in-depth evaluation and continued monitoring of vaccination coverage in the community can avert deterioration of coverage and accumulation of susceptible children.
A more-systematic and relatively inexpensive method to preliminarily identify pockets of need is to review immunization histories in school records. These immunization records are an indication of the children’s vaccination status at 19 to 35 months of age. If these reviews show a pattern of delayed immunization among preschoolers, additional resources can be directed to verify and correct a problem in coverage among young children.18,19 Another method to identify immunization pockets of need is immunization registries. Registries, when complete and functional, are tools that can be used for mapping coverage levels in communities on a real-time basis.
Unlike some vaccination coverage assessments that use only data verified by providers, our method of determining coverage for each child combined vaccination history from all available sources. Although most providers responded, some of them did not have any information on vaccination coverage for children without parent-held cards. We cannot exclude the possibility that inadequacies in the clinical records for the populations we studied may have biased our results among sites with the lowest provider response rates (Detroit and New York).
Although the nation as a whole attains immunization coverage levels sufficient to block disease transmission, pockets of susceptibility may act as potential reservoirs of infection.20–22 Polio and measles no longer circulate in the United States, but disease may be imported from abroad. Transmission of imported disease in undervaccinated populations may threaten the success of disease-elimination efforts. Thus, studies such as this one are important to establish whether undervaccination is a problem in specific communities.11,23,24
CONCLUSIONS
Although the vaccination coverage was high for HPSA children in Colorado, New York, and San Diego, it was low in Detroit. A priority is to identify other underserved areas such as Detroit that are lagging in vaccination coverage and ensure that high coverage is attained and maintained.25 Household surveys are too expensive and labor intensive for routine use. Therefore, proven methodologies must be reintroduced to monitor vaccination coverage among population subgroups or small geographic areas. Several methodologies are available for the review of immunization histories such as school records or the use of population-based registries for which functional registries exist. These methodologies may be a more-practical approach unless training local interviewers can be demonstrated as a feasible alternative.
Acknowledgments
We gratefully acknowledge Dr Susan Chu for careful review of this article and suggestions that helped refine our conclusions.
Footnotes
- Received June 6, 2003.
- Accepted November 12, 2003.
- Address correspondence to Jorge Rosenthal, PhD, MC, National Immunization Program, Centers for Disease Control and Prevention, MS-E86, 1600 Clifton Rd, Atlanta, GA 30333. E-mail: jyr4{at}cdc.gov
REFERENCES
- Copyright © 2004 by the American Academy of Pediatrics