ELECTRONIC ARTICLE |


* Department of Pediatrics and Strong Childrens Research Center, University of Rochester School of Medicine and Dentistry, Rochester, New York
Department of Emergency Medicine and Strong Childrens Research Center, University of Rochester School of Medicine and Dentistry, Rochester, New York
Department of Social Work, Strong Memorial Hospital, University of Rochester School of Medicine and Dentistry, Rochester, New York
|| National Immunization Program, Centers for Disease Control and Prevention
| ABSTRACT |
|---|
|
|
|---|
Objective. To assess the effect of a community-wide reminder, recall, and outreach (RRO) system for childhood immunizations on known disparities in immunization rates between inner-city versus suburban populations and among white, black, and Hispanic children within an entire county.
Setting. Monroe County, New York (birth cohort: 10 000, total population: 750 000), which includes the city of Rochester. Three geographic regions within the county were compared: the inner city of Rochester, which contains the greatest concentration of poverty (among 2-year-old children, 64% have Medicaid); the rest of the city of Rochester (38% have Medicaid); and the suburbs of the county (8% have Medicaid).
Interventions. An RRO system was implemented in 8 city practices in 1995 (covering 64% of inner-city children) and was expanded to 10 city practices by 1999 (covering 74% of inner-city children, 61% of rest-of-city children, and 9% of suburban children). The RRO intervention involved lay community-based outreach workers who were assigned to city practices to track immunization rates of all 0- to 2-year-olds, and to provide a staged intervention with increasing intensity depending on the degree to which children were behind in immunizations (tracking for all children, mail, or telephone reminders for most children, assistance with transportation or scheduling for some children, and home visits for 5% of children who were most behind in immunizations and who faced complex barriers).
Study Participants. Three separate cohorts of 0- to 2-year-old children were assessedthose residing in the county in 1993, 1996, and 1999.
Study Design. Immunization rates were measured for each geographic region in Monroe County at 3 time periods: before the implementation of a systematic RRO system (1993), during early phases of implementation of the RRO system (1996), and after implementation of the RRO system in 10 city practices (1999). Immunization rates were compared for children living in the 3 geographic regions, and for white, black, and Hispanic children.
Immunization rates were measured by the same methodology in each of the 3 time periods. A denominator of children was obtained by merging patient lists from the practice files of most pediatric and family medicine practices in the county (covering 85% to 89% of county children). A random sample of children (>500 from the suburbs and >1200 from the city for each sampling period) was then selected for medical chart review at practices to determine demographic characteristics (including race and ethnicity) and immunization rates. City children were oversampled to allow detection of effects by geographic region and race. Rates for the 3 geographic regions and for the entire county were determined using Stata to adjust for the clustered sampling.
Main Outcome Measures. Immunization rates at 12 and 24 months for recommended vaccines (4 diphtheria-tetanus-pertussis:3 polio:1 measles-mumps-rubella:
1 Haemophilus influenzae type b on or after 12 months of age).
Results. Disparities by Geographic Region: Baseline immunization rates (1993) for 24-month-olds were as follows: inner city (55%), rest of city (64%), and suburbs (73%), with an 18% difference in rates between the inner city and suburbs. By 1996, immunization rates rose faster in the inner city (+21% points) than in the suburbs (+14% points) so that the difference in rates between the inner city and suburbs had narrowed to 11%. In 1999, rates were similar across geographic regions: inner city (84%), rest of city (81%), and suburbs (88%), with a 4% difference between the inner city and suburbs. Disparities by Race and Ethnicity: Immunization rates were available in 1996 and 1999 by race and ethnicity. Twenty-four-month immunization rates in 1996 showed disparities: white (89%), black (76%), and Hispanic (74%), with a 13% difference between rates for white and black children and a 15% difference between white and Hispanic children. In 1999, rates were similar across the groups: white (88%), black (81%), and Hispanic (87%), with a 7% difference between rates for white and black children, and a 1% difference between white and Hispanic children.
Conclusions. A community-wide intervention of patient RRO raised childhood immunization rates in the inner city of Rochester and was associated with marked reductions in disparities in immunization rates between inner-city and suburban children and among racial and ethnic minority populations. By targeting a relatively manageable number of primary care practices that serve city children and using an effective strategy to increase immunization rates in each practice, it is possible to eliminate disparities in immunizations for vulnerable children.
Key Words: immunization rates reminders recall disparities
Abbreviations: RRO, reminder, recall and outreach VFC, Vaccines for Children
| INTRODUCTION |
|---|
|
|
|---|
Studies have described barriers to immunizations among the populations of children with lowest rates.6,1416 Suggestions for overcoming these barriers generally involve targeting of high-risk populations with specific interventions that have demonstrated effectiveness. During the past decade, new studies,1720 systematic reviews,2126 and guidelines from advisory groups7,15,27,28 have published evidence-based strategies designed to improve childhood immunization rates; yet disparities in rates persist.7,8
Little evidence exists that interventions that are effective in specific clinical settings can eliminate disparities across entire populations. For example, although patient reminder/recall systems have been found to improve immunization rates in a variety of clinical settings18,19,2124,26 and are a major potential activity of community-wide immunization registries,29 such systems have not been shown to reduce disparities in immunization rates at the community level.
The objective of this study was to assess the impact of a community-wide reminder, recall, and outreach (RRO) system for childhood immunizations on known disparities in immunization rates between inner-city versus suburban populations and among white, black, and Hispanic children within an entire county.
| METHODS |
|---|
|
|
|---|
Setting
The study setting was Monroe County, New York, an upstate metropolitan county with a population of 750 000 surrounding the city of Rochester. For study purposes, the county was divided into 3 regions30the inner city of Rochester, in which >60% of young children qualify for Medicaid; the rest of the city of Rochester, comprised of the remaining census tracts in the city; and the suburbs surrounding the city. These regions were previously analyzed in health services studies in the early 1990s30 and retained for comparisons. Like many regions in the United States,31 both poverty and minority populations are concentrated in the inner city of Rochester, whereas the suburbs have low rates of poverty and consist mostly of white populations. For all of Monroe County, the poverty rate for children 0 to 4 years of age increased from 16% to 21% between 1990 and 1995, with poverty rates in the city remaining higher than 40%.32
In Monroe County, <1% of immunizations are provided by the health department, and these are primarily for school-aged children. The vast majority of preschool children are vaccinated within primary care practices. Previous studies have noted that nearly 100% of Monroe Countys young children receive medical care at primary care practices, and nearly all make at least 1 visit to a primary care provider within the first 2 years of life.33,34
The population for assessment of immunization rates was all 0- to 2-year-old children living in Monroe County. Rates were calculated at the standard reference ages of 12 and 24 months.35 Children living in outlying counties who were served by Monroe County practices were excluded because the goal was to assess childhood immunization rates for county residents.
The intervention targeted the 10 largest practices that serve mainly the inner-city or rest-of-city population.
Intervention
A randomized, controlled trial evaluating the effectiveness of an RRO for immunizations for children 0 to 2 years of age was performed in 6 city practices between March 1994 and August 1995; the methods have been reported elsewhere.19 Because this trial noted a 20% improvement in immunization rates of 2-year-olds compared with standard-of-care controls, the intervention was expanded in late 1995 to include the controls (ie, all 0- to 2-year-olds within these 6 practices) so that by 1996, 4100 children received the intervention (64% of inner city, 31% of rest of city, 8% of suburban, and 18% of all Monroe County). Two additional city practices were added in 1996 and 2 more were added in 1997. By mid-1999, 0- to 2-year-olds at 10 practices (6300 children; 74% of inner city, 61% of rest of city, 9% of suburb, and 32% of all Monroe County) were receiving the RRO. The intervention was at the practice level for city practices; thus, a small number of children who live in the suburbs but are served by these practices received the intervention as well.
The RRO intervention recruited lay outreach workers from the neighborhoods around the practices and assigned them to one or more city practices. Outreach workers 1) were trained to follow a strict reminder/recall protocol, 2) were provided with a list of age-eligible children for whom they were responsible, 3) set up a tickler-file system to track immunizations within their primary care practice and used medical charts to assess and monitor the immunization status of their caseload, and 4) applied the intervention protocol when children were behind in immunizations. The intervention was staged, with increasing intensity for children who were further behind in immunizationsall children were tracked; three-quarters received some type of reminder (telephone, postcard, or letter); many received multiple reminders; and a small number of children for whom all previous strategies failed (5%) received home visits to address barriers to care.19 The average caseload was 400 children. Practice-level immunization rates were determined and reviewed by the project leaders bimonthly between 1995 and 1999.
County-wide Assessment of Immunization Rates
Rates were assessed for the entire county and separately for the 3 geographic regions in 1993 (before any intervention), 1996 (when 46% of inner-city plus rest-of-city children received the intervention), and 1999 (when 68% of inner-city plus rest-of-city children received the intervention). Identical methods were used to assess rates for the 3 time periods except that the 1993 assessment did not include race or ethnicity, and used slightly different sampling percentages (8.3% instead of 10% for suburban practices).
Developing the Denominator
We created a listing of all primary care practices in the county, sent a letter to each practice requesting collaboration with chart reviews to measure immunization rates, and obtained a practice denominator for specific birth cohorts who would have been 2 years old at the time of chart review and had made at least 1 visit to the practice.
During each of the 3 assessment years, 83 to 85 primary care practices were eligible and 63 to 70 practices were assessed, including 100% of city-based practices, 77% to 86% of pediatric practices (mostly suburban), and 71% to 75% of family medicine practices. We were able to obtain denominator files or estimates of birth cohorts from most of the nonparticipating practices and calculated that 85% to 89% of the countys birth cohort was included in the practices that participated. Approximately 90% of participating practices were able to provide computer-generated listings of their patients (lower percentage in 1993). For practices that could not supply a computerized list, we reviewed every medical chart at the practice to identify the practices population of 0- to 2-year-olds. The individual practice patient lists were merged and duplicate records (children seen at multiple practices) were identified using matching techniques based on name, date of birth, and gender. Because patient mobility and changing of primary care practices can complicate population-wide measurement of immunization rates, the denominator files from all practices were carefully analyzed to match children who were seen at multiple practices, and overall >10% of children were identified at multiple sites. In addition to date of birth and gender, the denominator file contained the most recent street address for mapping subjects into the 3 geographic regions. For the 1996 and 1999 assessments, race and ethnicity were obtained; these measures were not available for the 1993 assessment.
Sample Selection
We used a stratified, clustered sampling design with the primary sampling unit being the practice, then sampling from practices stratified by city versus suburban location. Patient records were assigned a random number; a 10% random sample was selected from practices located in the suburbs, and a 25% random sample was selected from practices located in the city. This sampling strategy ensured sufficient sample size (>500 from suburbs and >1200 from city for each sampling period) to estimate immunization rates within geographic areas with 95% confidence intervals of ± 5 percentage points at baseline rates of 80%.
Medical Chart Reviews
Individual medical charts were reviewed with data recorded on a standardized abstraction form. Demographic information (date of birth, gender, race, ethnicity, most recent street address, most recent insurance, number of primary care practices) and specific immunization dates were recorded.35 Progress notes, summary pages, and interpractice communication records were all reviewed to locate, verify, and cross-check immunizations received. Interrater reliability checks were performed on
1% of charts with agreement for >99% of the subjects. A second chart review at the practice was performed for children seen at multiple practices (to accurately merge records) and for all children determined to lack any immunizations on the first review (to confirm that immunizations were truly lacking and not just missed because of abstraction error).
Measures
Race and ethnicity (for the 1996 and 1999 assessments) were classified as white, black, or Hispanic, consistent with Office of Management and Budget criteria.36 Because of small numbers, Asian race (when available) was included in the calculations as "white."36 Up-to-date measures for recommended vaccinations were calculated for individual vaccinations and for standard combinations of vaccinations.4,5,35
Analysis
Statistical adjustments were made (using Stata software37) to account for the following: 1) the probability weights of 10% or 25% sampling, 2) clustering (including a practice term as the primary sampling unit), and 3) stratification (city or suburban practice). Immunization rates were calculated for the entire county and the 3 geographic regions, as well as for the 3 racial/ethnic groups.
| RESULTS |
|---|
|
|
|---|
|
|
|
Comment
This study found that extending a reminder, recall, and outreach intervention for childhood immunizations to the majority of children residing in a large city was associated with a marked reduction of disparities in immunization rates between city children and suburban children, and between white children and black or Hispanic children. A "dose response effect" was noted as the intervention expanded between 1996 and 1999 to more inner-city children, with disparities in immunization rates narrowing even further. A "dose response effect" also appeared with greater rise in immunization rates in the inner city (where three quarters of children received the intervention) than the rest of the city (where fewer received the intervention).
Disparities in health measures represent one of our nations most vexing problems. Multiple factors have been identified, but no easy solutions have been found.39,40 For childhood immunizations, it does not seem that lack of parental motivation or concerns about vaccine safety are major causes of the lower vaccination rates among impoverished and minority children.10,16,41 In fact, there is some evidence that parents of these children are less likely to be concerned about vaccine safety or efficacy than parents of nonpoor or white children.42 Similarly, there is little evidence that provider bias or ineffectiveness account for these disparities; in fact, some data suggest that providers serving high-risk populations are more aggressive in their immunization practices than providers serving populations of higher socioeconomic status.4345 The major cause of lower immunization rates16,46 seems to be "the immunization information gap"47a combination of patient factors such as barriers to care, missed appointments, and unfamiliarity with the vaccination schedule; provider factors including failure to identify children who are behind and to apply effective interventions such as reminder and recall; and health care system factors including lack of community-wide immunization registries or interventions, access barriers, and cost issues. Often multiple factors exist, resulting in children being behind in immunizations without parents or providers recognizing it; hence, the "immunization information gap." Focusing on elimination of only 1 barrier may not reduce disparities. For example, racial disparities in receipt of immunizations have been found to persist in settings where free vaccine is available9 and in managed care settings.48
Some experts have suggested that the solution to racial and ethnic disparities is to target minority populations with special interventions or services.49 Our study suggests that targeting primary care practices that serve geographic areas where minority children reside may reduce or eliminate racial and ethnic disparities without the need for differential interventions according to race or ethnicity.
The essence of this community-wide intervention is that we extended a recommended practice-level intervention7,15,2224,27patient reminder and recallto the largest primary care practices that serve the most vulnerable children. There are several advantages to intervening on a practice-level. First, focusing on primary care practices is a more efficient way to identify children and to target an entire population than other potential interventions such as door-to-door campaigns,50 census-level outreach,51 or targeting children according to risk factors.23 Second, collaborating with primary care practices results in a natural entrée for patient-level interventions because most families are closely linked with their medical homes but many may be suspicious of governmental or external interventions.39 Third, interventions performed in primary care practices can result in other practice-level changes that have demonstrated effectiveness,2226 such as provider prompts, audit and feedback, and standing orders.
One of the hallmarks of recent quality-improvement initiatives is to implement strategies that have demonstrated effectiveness systematically, rather than searching for novel interventions.5254 Our intervention adopted a successful practice-level strategy to the community-wide level. Recent advances make this type of community-wide intervention more feasible. Community and state immunization registries are expanding29 and will be able to provide efficient denominator-based tracking and reminder systems (we used paper files and created a manual tracking system). A challenge for practices is to determine which children are behind in immunizations. Scattering of immunization records exacerbates this problem (and was noted in our study),55 and immunization registries that span practices have the potential to facilitate this tracking and identification process. Although practices electronic billing systems could accomplish this as well, few providers utilize these billing systems to track and recall children for immunizations, they do not contain algorithms for immunization status and do not link records across practices.16,26,40 Although their potential remains to be seen, immunization registries may help to reduce immunization disparities on a community level if they are combined with systematic reminder, recall, and outreach interventions.
One concern about our intervention involves cost. In the original randomized clinical trial19 the cost of the intervention was $5.27 per child per month and the cost per additional child brought up to date was $316 over a 1-year period. Because the intervention was subsequently applied to all patients within the 10 practices, it is not possible to calculate the cost-effectiveness of the current intervention. The current costs of the entire program are $240 000 per year 70% for outreach worker salaries and the remainder for supervisory personnel, computer and administrative support, and local travel, phone, and other expenses for the outreach workers. Because the 10 practices have a birth cohort of 3189 and the intervention is applied for the first 2 years of life and beyond for children still behind, >6400 children are served, for a cost of $38 per child per year, or $3.12 per child per month. The lower costs after the randomized trial are attributable to expanding the outreach caseload as immunization rates increased. It is important to note that the intervention described in this study not only increased immunization rates but also had a beneficial spillover effect by increasing health supervision visits and preventive screening for anemia and lead poisoning, thus providing additional benefits beyond immunization delivery.19
This study has several limitations. Regarding external validity, our intervention relied on the finding that nearly all children in Rochester make at least 1 contact with a primary care practice during their first 2 years of life, a situation typical of children (including poor children) across the United States.56 This allowed for the intervention to be based in practices. Practice-level interventions may be unsuccessful in communities in which a large proportion of children never visit a primary care provider. Also, in some communities in which the majority of urban children are served by a very large number of primary care practices (each having few children), it may be less feasible to focus interventions on a few large practices. However, many urban centers mirror the situation in Rochester in which a relatively few primary care practices and clinics serve a high proportion of urban children.
A second potential limitation is that this study was conducted in Rochester, New York, a community with recognized high levels of pediatric care. However, the 1993 baseline county-wide immunization rates of 66% at 24 months (55% in the inner city) were similar to national immunization rates and to low rates reported in large urban centers.57,58
Third, our intervention was implemented at primary care sites and not centrally; this was necessary to track records and charts in the period before computerized registries and also resulted in high acceptance by practices and families. It is possible that our study findings would not be applicable to a centrally operated tracking and outreach program such as a centralized immunization registry. Furthermore, our study does not provide evidence in either direction of the effectiveness of reminder/recall in suburban settings.
Notably, the reduction in racial disparities in Rochester was made possible by the high racial and ethnic clustering in the city of Rochester. In our setting, 80% of the countys black children, 83% of Hispanic children, and 31% of white children were served by the city practices receiving the RRO intervention. Conversely, 68% of children in the city practices receiving the RRO intervention were either black or Hispanic, while 25% of children in practices not receiving the intervention were black or Hispanic. Because the inner-city practices served most of the countys minority children, interventions directed at those practices were able to reduce racial and ethnic disparities at the county level. Although this demographic pattern exists in many urban areas and across the United States,59 a community with less clustering of minority populations in the city might have different results if only city practices were targeted by interventions.
This study also has limitations to internal validity. Immunization rates were assessed using medical chart reviews at participating practices, and it is possible that the 11% to 15% of children who were not included had immunization rates different from those included in the assessments. However, because all city-based practices participated, children who were not included were more likely to reside in the suburbs; their lack of inclusion would not have affected estimates of immunization rates for city children but could possibly have affected estimates of disparities. In addition, children who were never seen in a primary care practice would have been missed by the immunization assessments and also by the intervention. We believe this group is small based on findings from previous studies in Rochester emergency departments34,60 that noted that almost 100% of infants and toddlers seen in the pediatric emergency departments had made at least 1 visit to their primary care practice during their life (and therefore would have been included in the denominators for assessment), and by random digit dial surveys noting that few children living in Rochester lacked a medical home.61,62 Also, the birth cohorts determined by the immunization assessments (adjusted for the 11%15% not assessed) were virtually identical to the birth cohorts of Monroe County from the US census. For example, our estimate of a birth cohort of 10 066 in 1999 was close to the US Census count of 10 488 Monroe County persons under 1 year of age in 1990.63
A second possible concern about internal validity is that the assessments were conducted by medical chart review, with no contact of patients, and some immunizations received at nonparticipating practices might have been missed by the chart reviews. This would be a problem if nearly all primary care practices had not participated in the immunization assessments, but should not pose a major bias, because most county children were included. Also, some immunizations received outside of the Rochester area may not be recorded in chart reviews. Although there is no perfect method to measure immunization rates, the National Immunization Survey currently relies on parents to indicate the providers who vaccinated their children, and then conducts medical chart reviews for determining immunization dates and coverage rates.64 Thus medical chart review is currently the "gold standard" for assessment of immunization dates.
Most importantly, it is possible that the reduction in disparities and the greater rise in immunization rates among inner-city and minority children were not the result of the intervention but other secular trends occurring in the inner city of Rochester. There were no other major immunization interventions occurring during this time period in the city of Rochester. Although overall communications about immunizations increased during the 1990s, communications from managed care plans, the Department of Health, or family or community organizations did not specifically target the city population or city practices during this period. The introduction of the Vaccines for Children (VFC) Program for children covered by Medicaid or not having insurance coverage for vaccines in early 1994 did disproportionately affect city children, but immunization rates continued to rise well after 1994 without significant changes in the number of children qualifying for VFC vaccines. Because all city practices enrolled in the VFC program early in 1994, any potential impact of the VFC program would not have affected the reduction in disparities in immunization rates between 1996 and 1999. Similarly, Medicaid managed care increased during the 1990s, but none of these plans instituted special immunization interventions because our city-wide RRO program existed.
| CONCLUSION |
|---|
|
|
|---|
| ACKNOWLEDGMENTS |
|---|
We appreciate the assistance of Drs Klaus Roghmann, Andrew Doniger, and Nancy Bennett on various phases of this work.
| FOOTNOTES |
|---|
Address correspondence to Peter G. Szilagyi, MD, MPH, University of Rochester School of Medicine, Box 632, Strong Memorial Hospital, 601 Elmwood Ave, Rochester, New York 14642. E-mail: peter_szilagyi{at}urmc.rochester.edu
This work was presented in part at the 1998 Annual Meeting of the Pediatric Academic Societies, New Orleans, LA, May 4, 1998 (presidential plenary session); the 1998 National Immunization Conference, Atlanta, GA, July, 1998; the 2002 National Immunization Conference, Denver, CO, April 30, 2002 (plenary session); and the 2002 Annual Meeting of the Pediatric Academic Societies, Baltimore, MD, May 5, 2002.
| REFERENCES |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
P. G. Szilagyi, G. Fairbrother, M. R. Griffin, R. W. Hornung, S. Donauer, A. Morrow, M. Altaye, Y. Zhu, S. Ambrose, K. M. Edwards, et al. Influenza Vaccine Effectiveness Among Children 6 to 59 Months of Age During 2 Influenza Seasons: A Case-Cohort Study Arch Pediatr Adolesc Med, October 1, 2008; 162(10): 943 - 951. [Abstract] [Full Text] [PDF] |
||||
![]() |
K. Fiscella and R. M. Epstein So Much to Do, So Little Time: Care for the Socially Disadvantaged and the 15-Minute Visit Arch Intern Med, September 22, 2008; 168(17): 1843 - 1852. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. Wasserman, D. Bender, and S.-Y. D. Lee Use of Preventive Maternal and Child Health Services by Latina Women: A Review of Published Intervention Studies Med Care Res Rev, February 1, 2007; 64(1): 4 - 45. [Abstract] [PDF] |
||||
![]() |
M. E. O'Connor, B. S. Matthews, and D. Gao Effect of open access scheduling on missed appointments, immunizations, and continuity of care for infant well-child care visits. Arch Pediatr Adolesc Med, September 1, 2006; 160(9): 889 - 893. [Abstract] [Full Text] [PDF] |
||||
![]() |
K. J. Dombkowski, M. M. Davis, L. M. Cohn, and S. J. Clark Effect of missed opportunities on influenza vaccination rates among children with asthma. Arch Pediatr Adolesc Med, September 1, 2006; 160(9): 966 - 971. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. E. Findley, M. Irigoyen, M. Sanchez, L. Guzman, M. Mejia, M. Sajous, D. A. Levine, S. Chen, and F. Chimkin Community-Based Strategies to Reduce Childhood Immunization Disparities Health Promot Pract, July 1, 2006; 7(3_suppl): 191S - 200S. [Abstract] [PDF] |
||||
![]() |
P. G. Szilagyi, S. Schaffer, R. Barth, L. P. Shone, S. G. Humiston, S. Ambrose, and F. Averhoff Effect of Telephone Reminder/Recall on Adolescent Immunization and Preventive Visits: Results From a Randomized Clinical Trial Arch Pediatr Adolesc Med, February 1, 2006; 160(2): 157 - 163. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. C. Blanchard, Y. Haywood, B. D. Stein, T. L. Tanielian, M. Stoto, and N. Lurie In Their Own Words: Lessons Learned From Those Exposed to Anthrax Am J Public Health, March 1, 2005; 95(3): 489 - 495. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. R. Nerenz Health Care Organizations' Use Of Race/Ethnicity Data To Address Quality Disparities Health Aff., March 1, 2005; 24(2): 409 - 416. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. L. Kirschke, A. S. Craig, W. Schaffner, J. R. Daugherty, J. Narramore, and M. R. Griffin Childhood Immunization Rates Before and After the Implementation of Medicaid Managed Care Arch Pediatr Adolesc Med, March 1, 2004; 158(3): 230 - 235. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. J. Hambidge, A. J. Davidson, S. L. Phibbs, V. Chandramouli, G. Zerbe, C. W. LeBaron, and J. F. Steiner Strategies to Improve Immunization Rates and Well-Child Care in a Disadvantaged Population: A Cluster Randomized Controlled Trial Arch Pediatr Adolesc Med, February 1, 2004; 158(2): 162 - 169. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. A. Schillaci, H. Waitzkin, E. A. Carson, C. M. Lopez, D. A. Boehm, L. A. Lopez, and S. F. Mahoney Immunization Coverage and Medicaid Managed Care in New Mexico: A Multimethod Assessment Ann. Fam. Med, January 1, 2004; 2(1): 13 - 21. [Abstract] [Full Text] [PDF] |
||||
Read all P3Rs
| ||||||||||||||