
* Pediatric Immunization Program, the Department of Pediatrics
Department of Health Studies, University of Chicago, Chicago, Illinois
| ABSTRACT |
|---|
|
|
|---|
Methods. A self-administered survey was completed by pediatricians, general practitioners, and family practitioners in Cook County, Illinois. Surveys included 6 open-ended vignettes describing hypothetical children delayed in immunization for whom participants were asked to design catch-up regimens. Bivariate and multivariate logistic regression were used to determine predictors of correct response. The surveys also inquired about management of scenarios that might be perceived as contraindications to immunize with the Haemophilus influenzae type b or measles-mumps-rubella vaccines.
Results. The mean score of correct responses was 1.83 of a possible 6.0. Almost one third of respondents answered all 6 vignettes incorrectly. The proportion of incorrect responses was high for all 6 vignettes (39%86%), but higher for questions that addressed the immunization of children older than 12 months. Errors in vaccine administration were most commonly attributed to omitted vaccines, with varicella-zoster vaccine and pneumococcal conjugate vaccine omitted most frequently. Pediatricians were >4 times more likely to answer correctly than were family practitioners. Participants in the Vaccines for Children (VFC) program were more than twice as likely to answer correctly than were non-VFC providers. Knowledge of contraindications was inconsistent, particularly for measles-mumps-rubella vaccine.
Conclusions. Childhood vaccine providers have substantial knowledge deficits of recommended immunization schedules and vaccine contraindications that may contribute to missed opportunities to immunize. Pediatricians and participants in the VFC program were more successful at designing catch-up regimens for children with immunization delay.
Key Words: vaccination immunization immunization delay children provider practices vaccine contraindications
Abbreviations: AAP, American Academy of Pediatrics ACIP, Advisory Committee on Immunization Practices VFC, Vaccines for Children AMA, American Medical Association Hib, Haemophilus influenzae type b MMR, measles-mumps-rubella HIV, human immunodeficiency virus VZV, varicella-zoster vaccine DTaP, diphtheria-tetanus-acellular pertussis PCV, pneumococcal conjugate vaccine IPV, inactivated polio vaccine
| INTRODUCTION |
|---|
|
|
|---|
Missed opportunities for immunization occur most commonly at acute illness visits, often associated with provider misconceptions of contraindications for immunization.36 In this instance, no vaccines are given.
Visits during which some but not all vaccines required for catch-up are administered have been demonstrated to contribute to immunization delay in an inner-city reminder-recall program.7 The occurrence of such incomplete vaccine administration suggests that physicians may have difficulty constructing catch-up regimens, particularly when children are delinquent in multiple vaccines. Alternatively, physicians may face parental resistance toward a large number of simultaneous injections. This issue becomes especially important in a child with known vaccine noncompliance, as the physician has no assurance that the child will return if a catch-up plan is formulated that requires >1 visit.
Since the early 1990s, local health departments and the federal government have implemented programs to remove economic barriers to childhood immunization. The Vaccines for Children (VFC) program was established in 1994 to provide vaccines free of charge to physicians and clinics caring for children of Native American or Alaskan descent, Medicaid recipients, children who are uninsured, or those whose health insurance does not cover immunizations.8 Evaluations of the VFC program to date suggest that VFC providers are less likely to refer children to public vaccine clinics.811 Since the programs inception, rates of immunization coverage have improved, mirroring the decrease in public health referrals.8
Because visits where some but not all required vaccines were given occurred frequently in an underimmunized population that we had studied,7 we hypothesized that some physicians may experience difficulty in determining appropriate strategies for correcting immunization delay for a given child. Therefore, the primary objectives of this study were 1) to determine the success of physicians at designing catch-up regimens for children delayed in immunizations and 2) to determine the knowledge of physicians regarding contraindications to immunization. We also examined provider approaches to correcting immunization delay and the types of errors made by physicians when designing catch-up regimens.
| METHODS |
|---|
|
|
|---|
Questions
The survey instrument was modeled on that used by Wood et al12 in 1992. They solicited the design of catch-up regimens for 3 hypothetical children (ages 5, 9, and 12 months) delinquent in immunizations, and presented 6 scenarios addressing possible contraindications to receipt of specific vaccines. Our survey used the 3 vignettes of Wood et al and an additional 3 that addressed catch-up immunization regimens for older children (15 months, 2 and 5 years), as well as 5 possible contraindication scenarios (Table 1) created by one of us (R.S.D.).
|
A second set of questions addressed immunization contraindications with regard to Haemophilus influenzae type b (Hib) and measles-mumps-rubella (MMR) vaccines, representative of bacterial component and live viral vaccines, respectively. Five scenarios described commonly encountered situations that might incorrectly be considered contraindications to administration of either or both vaccines. Three scenarios described situations relating to the immune status of the child (inhaled steroids) or a family member (human immunodeficiency virus [HIV] infection or chemotherapy). Two scenarios described temporary situations (fever or receipt of antibiotics for an acute infection) where a physician might elect to defer immunization due to personal judgment or parental preference.
Scoring of Responses
We used recommendations of the AAP and ACIP to evaluate responses,1,2 scoring each vignette according to the completeness and timing of vaccine administration. Since the vignettes provided for 2 patient encounters, we anticipated use of 2 different approaches to design a catch-up regimen. A more aggressive approach would administer all delinquent vaccines (up to 7 injections in some scenarios) at the initial visit, with subsequent doses administered at an appropriately spaced second visit. A less aggressive approach would use 2 visits to administer all relevant vaccines and specify a temporally proximate interval between them. Both approaches were scored correct if all required vaccines were included in the 2 visits. We allowed up to 8 weeks to complete vaccine administration using the less aggressive strategy.
Responses were scored as incorrect if physicians made any of the following errors: omission of any age-appropriate vaccine in the 2 encounters; administration of unnecessary doses, for example, 2 doses of Hib after 15 months of age; administration of age-inappropriate vaccines, for example, varicella-zoster vaccine (VZV) or MMR before 1 year of age; administration of sequential doses separated by an inappropriate time interval, for example, 2 doses of diphtheria-tetanus-acellular pertussis (DTaP) vaccine <4 weeks apart; or nonsimultaneous administration of 2 live virus vaccines (MMR or VZV) <4 weeks apart. Since the recommended immunization schedule is flexible in the age of administration for certain vaccines (for example, VZV may be given at 1218 months), we did not count as incorrect any omission before the upper limit of the age range.
Statistical Analysis
The study population was described with respect to demographic characteristics provided by the AMA database and practice-related variables included in the survey.
We categorized correct responses to each vignette as using the more aggressive or less aggressive strategies. For incorrect responses, we classified errors as those of omission, unnecessary or age-inappropriate administration, or inappropriate interval timing, and analyzed them for each vaccine individually and all vaccines combined. Using vignette 5 (Table 1), we determined the number of vaccines physicians were willing to administer at 1 visit. Vignette 5 required the highest number of vaccines (7). We performed a subanalysis of this vignette excluding pneumococcal conjugate vaccine (PCV) and VZV, the 2 vaccines added most recently to the recommended immunization schedule. The purpose was to determine if error rates were much lower if these 2 vaccines were excluded.
For each respondent, the number of correct vignettes was summed to create a single score ranging from 0 to 6. Participants were then divided according to whether they scored above (
2) or below (
1) the mean correct score. This variable was analyzed as the outcome in a logistic regression model to determine if demographic or practice-related variables predicted a higher score. First, bivariate analyses tested the association between scoring above or below the mean and each demographic or practice-related variable. Variables evaluated included gender, location, year of medical school graduation, medical school location, academic affiliation, specialty, percentage of patients younger than 5 years, proportion of uninsured patients and those receiving Medicaid, level of participation in the VFC program, and the number of patient encounters in a typical day that resulted in administration of vaccines. The dichotomized score was also tested in a multivariate logistic regression model, including the above variables. Each variables significance in the model was tested using either the likelihood ratio or Wald test. We were concerned that some variables were highly correlated with each other and would be colinear if entered simultaneously in a regression model. Specifically, the degree of participation in the VFC program was highly correlated with the proportion of patients receiving Medicaid (Spearmans rank correlation coefficient
= 0.75), and the number of vaccine encounters in a typical day was correlated with the proportion of patients younger than 5 years (Spearmans
= 0.66). Since participation in VFC and the number of vaccine encounters in a typical day were of greater interest, the other 2 variables were omitted from the multivariate model. We did not find a high correlation between participation in VFC and either the proportion of uninsured patients (Spearmans
= 0.36) or the number of vaccine encounters in a typical day (Spearmans
= 0.16).
For the 5 possible contraindication scenarios, we determined the proportion of physicians who would choose not to give either MMR or Hib vaccines under the described circumstances.
Nonresponse Analysis
To determine if respondents differed from nonrespondents with respect to vaccine knowledge, we performed 3 analyses. First, respondents and nonrespondents were compared using demographic variables provided by the AMA. Second, respondents to the first and second mailings were compared according to the mean number of correct responses to the catch-up vignettes. Comparisons were performed using either
2 or Student t test. Also, a randomly chosen subsample of nonrespondents was contacted by telephone and asked to complete a shortened version of the demographic portion of the survey and a single vignette, to ascertain whether immunization knowledge of nonrespondents differed substantially from respondents. Vignette 5 was selected for this purpose as it was the question containing the fewest details of vaccine history, and provided sufficient variability in preliminary analysis.
Data were analyzed using STATA 7 (STATA Corporation, College Station, TX).
| RESULTS |
|---|
|
|
|---|
Demographic characteristics of respondents and nonrespondents are compared in Table 2. A higher proportion of female recipients, pediatricians, and US medical school graduates completed the survey. Respondents graduated from medical school more recently than nonrespondents. Practice characteristics of respondents are presented in Table 3. More than half the respondents were pediatricians. Fifty percent reported administering vaccines in >5 patient encounters in a typical day, and 61% reported some participation in the VFC program.
|
|
|
|
|
|
Factors associated with an above average score using bivariate analysis included female gender, specialization in pediatrics, academic affiliation, urban location, higher proportion of patients younger than 5 years, more vaccine encounters in a typical day, participation in the VFC program, and higher proportion of patients receiving Medicaid (Table 6). When the predictors were entered into a multivariate logistic regression model (Table 7), VFC providers were more than twice as likely to achieve an above average score. Pediatricians were 4.3 times more likely than family practitioners and 2.9 times more likely than practitioners in other fields to score above average. Female physicians were 50% more likely to score above average than were male physicians. Although a higher number of vaccine encounters in a typical day was strongly predictive of correct response in the bivariate analysis, this variable was confounded in the multivariate model by specialty and participation in the VFC program.
|
|
|
| DISCUSSION |
|---|
|
|
|---|
Except for the case of the 5-month-old child, physicians tended to use the less aggressive strategies when designing catch-up regimens. We previously found that the rate of on-time compliance with all age-appropriate immunization recommendations could have been 20% to 44% higher had all doses required for catch-up been administered at visits where at least 1 of the missing immunizations were administered.7 Thus, provider difficulty in constructing catch-up immunization regimens and/or decisions to implement less aggressive catch-up strategies may have a relatively unappreciated impact on immunization rates. The less aggressive catch-up strategies still fell within the recommended ACIP/AAP guidelines. However, choosing to defer immunizations in a child with known immunization delay results in a missed opportunity to immunize if the child fails to return for the follow-up necessary to complete a "less aggressive" strategy.
Among respondents, pediatricians were more likely to design correct catch-up regimens than were family practitioners. Such differences in correct responses may be attributed to differences in training or experience with pediatric patients and well child care. A study based on data by the National Immunization Survey found that children immunized solely by pediatricians were 1.63 times more likely to be up to date than those immunized by family practitioners.16
Physicians providing immunizations through the VFC program were significantly more successful at designing catch-up regimens than those not participating in the program. The association of participation in the VFC program and knowledge of immunization catch-up is difficult to explain. It is possible that VFC providers are more likely to encounter children with immunization delay, and thus have greater familiarity with catch-up regimen design. However, data from the National Immunization Survey did not demonstrate increased immunization coverage among patients immunized by VFC providers.16
Individual errors in creating catch-up regimens were predominantly due to the omission of vaccines. VZV and PCV, the 2 newest vaccines recommended for routine pediatric administration, were omitted most frequently. Routine administration of VZV has been controversial, with a number of physicians choosing not to recommend the vaccine for their patients, and a high proportion of parents refusing it.17 It is likely that the extreme newness of PCV and physician unfamiliarity with the vaccine contributed to the high omission rate of this vaccine.
The highest proportion of unnecessary vaccine doses was for Hib, likely reflecting errors in understanding the complexity of age-associated recommendations for this vaccine. Age-associated errors were also evident for DTaP and PCV, including both unnecessary doses for older children and inappropriate timing of sequential doses, again suggesting that physicians are more familiar with vaccine recommendations for infants than for children older than 12 months.
The results of the contraindication scenarios suggest that physicians have substantive knowledge gaps regarding immunization contraindications. The high proportion of physicians who would defer MMR vaccine attributed to immunodeficiency in a family member is particularly concerning. Failure to immunize with MMR in such circumstances is incorrect for 2 reasons: 1) the live attenuated viruses contained in the vaccine are not transmissible to contacts1; and 2) the immunocompromised family member is at increased risk of infection if exposed to wild-type virus transmitted from an unimmunized contact.
The major limitation of our study is the relatively low survey response rate of 40%. Mailed physician surveys are typically responded to at a rate of
50%.18 We did not prescreen survey recipients for eligibility; many may have been ineligible because of factors such as retirement, migration, or type of practice. This possibility is supported by the fact that 8% of our survey questionnaires were returned unanswered for these sorts of reasons. Our survey was long and challenging, resulting in a high responder burden. Although limited by sample size, the results of our nonresponse analysis suggest that nonresponders are no more likely than responders to correctly design catch-up regimens. In fact, the higher proportions of responders who were female, pediatricians or US medical graduates were likely, given our findings, to bias our sample toward higher knowledge. Another limitation is the artificiality of the survey situation that may not accurately reflect the resources (for example nursing staff) that a physician may draw on in the design of actual catch-up regimens. We would have liked to compare our results with those of Wood et al12 to determine if the increased complexity of the immunization schedule has made catch-up regimens more difficult to design. However, we were unable to do so because of the aggregate presentation of their data.
The high error rate in response to our catch-up vignettes, combined with the predominant opinion of survey respondents regarding the difficulty of the task, suggests a need for educational opportunities as well as practice aids to assist physicians in the design of catch-up vaccine regimens. Improving physician knowledge of the recommended immunization schedule as well as contraindications to immunization should reduce the number of missed opportunities to immunize and improve overall immunization coverage among children at high risk for immunization delay.
| ACKNOWLEDGMENTS |
|---|
Note Added in Proof. During the revision of this manuscript, a 5-valent combination vaccine was licensed (PEDIARIX, GlaxoSmithKline). Use of this product might affect provider decisions to construct "more aggressive" or "less aggressive" catch-up scenarios in their responses and might alter some data in the "Required Doses" calculations in Table 4.
| FOOTNOTES |
|---|
Address correspondence to Robert S. Daum, MD, Section of Pediatric Infectious Diseases, University of Chicago Hospitals, 5841 S Maryland Ave, MC 6054, Chicago, IL 60637. E-mail: rdaum{at}peds.bsd.uchicago.edu
| REFERENCES |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
J. A. Boom, C. S. Nelson, L. E. Laufman, A. E. Kohrt, and C. A. Kozinetz Improvement in Provider Immunization Knowledge and Behaviors Following a Peer Education Intervention Clinical Pediatrics, October 1, 2007; 46(8): 706 - 717. [Abstract] [PDF] |
||||
![]() |
A. G. Fiks, R. W. Grundmeier, L. M. Biggs, A. R. Localio, and E. A. Alessandrini Impact of Clinical Alerts Within an Electronic Health Record on Routine Childhood Immunization in an Urban Pediatric Population Pediatrics, October 1, 2007; 120(4): 707 - 714. [Abstract] [Full Text] [PDF] |
||||
![]() |
E. T. Luman, L. E. Barker, K. M. Shaw, M. M. McCauley, J. W. Buehler, and L. K. Pickering Timeliness of Childhood Vaccinations in the United States: Days Undervaccinated and Number of Vaccines Delayed JAMA, March 9, 2005; 293(10): 1204 - 1211. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. R. Dominguez, J. S. Parrott, D. S. Lauderdale, and R. S. Daum On-Time Immunization Rates Among Children Who Enter Chicago Public Schools Pediatrics, December 1, 2004; 114(6): e741 - e747. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. E. Kohrt Child and Adolescent Immunizations: New Recommendations, New Standards, New Opportunities Pediatrics, October 1, 2003; 112(4): 978 - 981. [Full Text] [PDF] |
||||
![]() |
R. D. Clover Preventing Invasive Pneumococcal Disease in Children J Am Board Fam Med, September 1, 2003; 16(5): 464 - 465. [Full Text] |
||||
![]() |
S. Wallace Shortages require practices to take extra measures to keep patients up-to-date on vaccines: Calling the shots AAP News, August 1, 2003; 23(2): 54 - 56. [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||