ARTICLE |
a Department of Ambulatory Care and Prevention, Harvard Medical School and Harvard Pilgrim Health Care, Boston, Massachusetts
b Divisions of General Pediatrics
h Infectious Diseases, Children's Hospital Boston, Boston, Massachusetts
c Channing Laboratory and Division of Infectious Diseases, Brigham and Women's Hospital, Boston, Massachusetts
d Department of Pediatrics and Meyers Primary Care Institute
g Departments of Psychiatry and Pediatrics, University of Massachusetts Medical School, Worcester, Massachusetts
e Massachusetts Department of Public Health, Boston, Massachusetts
f MassHealth, Boston, Massachusetts
| ABSTRACT |
|---|
|
|
|---|
METHODS. We conducted a controlled, community-level, cluster-randomized trial in 16 nonoverlapping Massachusetts communities, studied from 1998 to 2003. During 3 years, we implemented a physician behavior-change strategy that included guideline dissemination, small-group education, frequent updates and educational materials, and prescribing feedback. Parents received educational materials by mail and in primary care practices, pharmacies, and child care settings. Using health-plan data, we measured changes in antibiotics dispensed per person-year of observation among children who were aged 3 to <72 months, resided in study communities, and were insured by a participating commercial health plan or Medicaid.
RESULTS. The data include 223135 person-years of observation. Antibiotic-use rates at baseline were 2.8, 1.7, and 1.4 antibiotics per person-year among those aged 3 to <24, 24 to <48, and 48 to <72 months, respectively. We observed a substantial downward trend in antibiotic prescribing, even in the absence of intervention. The intervention had no additional effect among children aged 3 to <24 months but was responsible for a 4.2% decrease among those aged 24 to <48 months and a 6.7% decrease among those aged 48 to <72 months. The intervention effect was greater among Medicaid-insured children and for broad-spectrum agents.
CONCLUSIONS. A sustained, multifaceted, community-level intervention was only modestly successful at decreasing overall antibiotic use beyond substantial secular trends. The more robust impact among Medicaid-insured children and for specific medication classes provides an argument for specific targeting of resources for patient and physician behavior change.
Key Words: antibiotic use parental knowledge randomized trial
Abbreviations: CDC—Centers for Disease Control and Prevention REACH Mass—Reducing Antibiotics for Children in Massachusetts
Reducing antibiotic overuse, particularly among children, has been identified as a public health priority since the mid-1990s.1,2 The rapid increase in resistance among common bacterial pathogens, such as Streptococcus pneumoniae,3–6 is widely believed to be fueled by high rates of antibiotic use, much of which is unnecessary.7–11 Because of the communicability of bacterial pathogens, the consequences of resistance have an impact on communities in addition to individual carriers. Young children have had the highest antibiotic-use rates of any age group12 and may be at particular risk for acquiring and spreading resistant organisms, especially in group settings such as child care.13 It is clear to many that interventions to reduce unnecessary prescribing will require community-level intervention that simultaneously targets all sources of perceived demand for unnecessary antibiotic use, as well as changing the supply side: physician prescribing behavior.14,15
Among the diverse attempts to intervene in this area have been interventions in specific health care delivery systems16,17 or for particular conditions, such as otitis media in children18 and bronchitis in adults.17 The Centers for Disease Control and Prevention (CDC) have implemented national efforts to address antibiotic overuse through education of providers,7 as well as campaigns to change the knowledge and attitudes of the public about the harms of antibiotic overuse.19 Statewide coalitions have used a variety of approaches to encourage appropriate antibiotic use, including physician behavior-change strategies and a variety of patient education approaches. Although overall national antibiotic-use rates have decreased markedly since the early 1990s,20,21 data are mixed on the ability of community-wide interventions to change antibiotic-use rates effectively. Most have been limited in the number of communities studied, the ability to control for differences among them, or the duration of intervention.22–26
We sought to determine, as precisely as possible, the impact of a sustained, community-wide program designed to change both physician and patient behavior to decrease unnecessary antibiotic use. Antibiotic resistance is a community-level public health concern, and randomization of individual patients or providers would be susceptible to unacceptable contamination between intervention and control states; therefore, we conducted a 16-community, cluster-randomized trial of the Reducing Antibiotics for Children in Massachusetts (REACH Mass) intervention. We previously reported measures of parental knowledge,27 physician self-reported behavior,28 and antibiotic resistance rates among colonizing isolates of S pneumoniae29,30; however, our primary goal was to test whether a 3-year sustained intervention decreased the number of dispensings of antibiotics to children overall. A secondary analysis tested whether the intervention increased the fraction of appropriate, narrow-spectrum agents used, compared with patterns seen in control communities. Finally, after analysis of baseline (October 2000) survey data from these communities showing that parents of Medicaid-insured children had more misconceptions regarding appropriate antibiotic use,27 we became particularly interested in whether differential effects of the intervention would be seen among children from low-income families.
| METHODS |
|---|
|
|
|---|
Intervention
The intervention was conducted during 3 successive cold and influenza seasons, (October through March) from 2000 to 2003. Activities were directed at providers and their practices and at patients (through direct mail, a Web site, pharmacies, and child care centers). A panel of local content experts and representatives of the Massachusetts Department of Public Health and local health plans adapted CDC guidelines for judicious antibiotic prescribing for use in Massachusetts. All REACH Mass messages and materials were designed to be consistent with these guidelines.
Materials Development
Materials were designed by using principles of academic detailing31 and social marketing to be simple, to be attractive, and to change specific behaviors of physicians or parents.32,33 Parent resources included a trifold brochure entitled "Kids and Antibiotics" with general information about antibiotic use and resistance; 4 illness-specific patient information cards on antibiotic use in colds, ear infections, fluid in the middle ear, and sore throat; and office posters with key messages about antibiotic use. Major messages presented in study materials included the following: (1) antibiotics are not helpful for cough, cold, and flu-like illnesses; (2) unnecessary antibiotic use contributes to resistance in individuals and communities; and (3) green nasal discharge does not indicate a need for antibiotics. In the final year of the study, information was presented to encourage parents and providers to discuss the option of "watchful waiting" for mild ear infections.18,34 An information sheet was specifically designed to be used as part of a discussion of appropriate antibiotic use at well-child visits. "Prescription" pads providing written recommendations for symptomatic treatment of viral infections were adapted from previous CDC-sponsored campaigns. A variety of stickers, lapel pins, otoscope insufflators, and additional materials were distributed with the REACH Mass logo. All messages and materials were consistent with those contained in CDC materials to promote judicious antibiotic use, aimed toward a seventh- to eighth-grade reading level, and were approved by the 4 participating health plans, a panel of community physicians, the Massachusetts Department of Public Health, and the Harvard Pilgrim Health Care institutional review board.
Physician Intervention
An introductory letter was mailed to all pediatricians and family physicians in intervention communities in the spring of 2000. All practices were approached, and, whenever possible, a single physician contact was established. Prescribing providers were invited to attend kickoff dinners for all practices in a community during the first intervention winter in which the general problem of antibiotic overuse and resistance was presented and the intervention was described in detail. In particular, we proposed to (1) provide a range of patient education materials to physician offices without charge, (2) provide ongoing information about antibiotic-use rates and resistance in the community, (3) provide feedback about prescribing by practice, and (4) serve as a general resource on issues of antibiotic prescribing and resistance. Physicians were also given copies of educational materials that parents would be receiving through direct mail during the course of the subsequent 3 winters to combat patient "demand" for unnecessary antibiotic use.
During the 3 intervention seasons, the physicians received approximately bimonthly faxed or e-mailed briefs (
1 page) on a topic related to antibiotic use, respiratory tract infections, or antibiotic resistance. Visits to each practice were made by an educational coordinator to answer questions about the study and to provide additional materials to physicians and practice staff. A second series of community dinner meetings for providers was conducted in the third intervention season to reinforce key messages and focus additionally on the diagnosis and treatment of acute otitis media. Although this study predated the release of professional guidelines in the United States endorsing "watchful waiting,"18 of selected cases of acute otitis media, data about the safety of this approach were reviewed. Investigators also presented at grand rounds in community hospitals wherever possible.
Parent Intervention
Addresses of families with at least 1 child who was younger than 6 years and residing in intervention communities were supplied by the 4 participating health plans. Intervention activities directed at parents included the following:
Data Collection and Analysis
We analyzed health insurance claims data from all children who were
6 years of age and resided in study communities (as defined by zip code clusters) and were insured by 1 of the participating health plans, with coverage for medications, for 90 days or more between September 1, 1998, and March 31, 2004. Total days of health-plan membership were divided by 365 to obtain person-years of observation in 3 age groups in each of the study years: 3 to <24, 24 to <48, and 48 to <72 months. Outcomes were analyzed as antibiotic dispensings per person-year of observation.
Claims (with International Classification of Diseases, Ninth Revision, diagnosis codes) for all ambulatory, emergency department, and inpatient hospital encounters were analyzed. A separate file contained pharmacy claims of all oral antimicrobial agents, identified by a list of national drug codes of interest. These pharmacy claims included only medicines that were actually dispensed to patients, including both primary prescriptions and refills.
The primary outcome of interest was the overall number of oral antibiotic dispensings per person-year of observation in the 3 age groups of interest in each study year. Antibiotic-dispensing rates were calculated on an annual basis from September 1, 1998, to August 31, 2003, to reflect the beginning of a new school year and respiratory illness season. Data were collected for 2 preintervention years (September 1, 1998, to August 31, 2000) and for 3 years during which intervention activities occurred (September 1, 2000, to August 31, 2003). Annual dispensing rates per person-year were plotted for patients who lived in intervention and control communities, stratified by age and commercial insurance or Medicaid. To account for clustering of individuals within communities, we used generalized linear mixed models, assuming a Poisson distribution for counts per person-year of antibiotic prescriptions dispensed. For analysis of secular trend, we modeled the annual rates by age in control communities only, accounting for clustering of observations within communities but no other covariates. Age-stratified models were used to assess intervention impact and included terms to allow for differences in baseline prescribing levels between intervention and control communities, secular trend during the study period, gender, and insurance type (for models not stratified by insurance). These models produced adjusted estimates of the percentage change in antibiotics dispensed per person-year during the 3-year intervention period. Intervention impact (the primary outcome) was calculated as the difference between this change in intervention and control communities. Similar age-stratified models were created to assess intervention impact among commercially insured and Medicaid-insured patients. Finally, we examined intervention impact on prescriptions by antibiotic class using the same analytic and statistical methods, with special attention to changing rates of amoxicillin-clavulanate and second-generation macrolide (azithromycin and clarithromycin) prescriptions. All analyses were performed by using SAS 9.1 (SAS Institute, Inc, Cary, NC).
| RESULTS |
|---|
|
|
|---|
|
22000 copies of the introductory brochure and first newsletter were mailed, with 2 similar-sized mailings in each of the subsequent years. Toward the end of the first intervention season, materials were also mailed to 156 child care centers, with workshops for child care professionals conducted in each of the 8 intervention communities in year 3. Prescribing reports were mailed to 77 clinicians with sufficient prescribing data available. A total of 19 issues of REACH Notes were faxed or e-mailed to 250 clinicians during the second and third intervention seasons. The REACH Mass educator maintained contact with both office staff and the primary clinician contact at each of the practices through telephone and in-person visits.
Secular Trends and Intervention Impact
Overall, antibiotic-use rates in year 1 of the study (baseline) were 2.8, 1.7, and 1.4 dispensings per person-year in the 3 age groups, 3 to <24, 24 to <48, and 48 to <72 months, respectively, and were similar among intervention and control communities (Table 2). Baseline use rates were slightly higher among children with Medicaid insurance compared with those with commercial insurance (P < .001). Because of these baseline differences in antibiotic use and knowledge between parents of Medicaid- and commercially insured children,27 we present both overall analyses and subanalyses stratified according to insurance type.
|
|
The intervention effect was greater among Medicaid-insured children compared with commercially insured children. For example, among those insured by Medicaid, the decrease in antibiotic prescribing attributable to the 3-year intervention was 4.5% among children aged 3 to <24 months (P = .01), 5.5% among those aged 24 to <48 months (P = .01), and 9% among those aged 48 to <72 months (P < .01). In contrast, among commercially insured children, a significant intervention effect of 5.1% was observed among children aged 48 to <72 months (P = .01) but not for the other age groups.
In year 1, first-line penicillins (penicillin and amoxicillin) accounted for slightly more than half (51%) of all antibiotic use. The fraction of antibiotic dispensings accounted for by each class was similar across age groups, with broad-spectrum macrolides (primarily azithromycin) accounting for 12%, 14%, and 13% in the 3 age groups, respectively. Because the educational intervention for physicians encouraged use of narrow-spectrum agents when appropriate,7 we examined the intervention impact on the prescribing of second-line penicillins (primarily amoxicillin-clavulanate) and second-line macrolides (primarily azithromycin; Table 3). The intervention was responsible for a decrease in second-line penicillin use of 9.2% (P = .03) and 21.3% (P < .0001) among all children aged 24 to <48 months and 48 to <72 months, respectively. The intervention impact for this class was most consistent among Medicaid-insured children, with intervention effects of 9.0% (P = .04), 14.3% (P = .02), and 22.7% (P < .01) in the 3 age groups, respectively. The intervention decreased second-line macrolide use in all 3 age groups. The 3-year intervention was responsible for a 6.7% decrease among children aged 3 to <24 months (P = .02), 12.7% among those aged 24 to <48 months (P < .01), and 22.5% among those aged 48 to <72 months (P < .0001). For this medication class, the magnitude of effect was generally larger among commercially insured children than for those with Medicaid.
|
| DISCUSSION |
|---|
|
|
|---|
The relatively small magnitude of impact of this intervention, even among Medicaid members, must be interpreted in light of the community-level approach, in which resources and exposures are diffused over a great number of individuals. In this case, we chose communities before assessing whether physicians who practiced within them would be receptive to participation in intervention activities. A substantial fraction (but a minority) of clinicians in each community attended educational sessions, and all practices received patient materials and prescribing feedback; however, there was clearly variability regarding engagement in intervention activities. Furthermore, because we measured the impact of the intervention in repeated cross-sections of a dynamic cohort, many of those included in the analysis did not receive the intervention's components. For example, the youngest children in the follow-up years were not even alive in the first intervention year. Similarly, those who had recently moved to a study community or transferred into 1 of the health plans from which data were obtained would not have had full exposure. Overall, we believe that this type of assessment at the community level, although most conservative in terms of detecting intervention effects, is the appropriate assessment of both secular changes in health care practices and the impact of community-level interventions.
Several studies have reported greater magnitudes of effect of interventions on physician practices.16,17 These studies may have engaged practices that were most receptive to change in this area and may be less generalizable to community-level approaches for this and other public health problems. True community-level interventions to promote judicious antibiotic use have shown mixed results. A nonrandomized trial showed a substantial impact of a multifaceted intervention among Medicaid members in a single county in Tennessee.25 In Wisconsin, a community intervention seemed to have an effect in 1 region compared with another,22 but results of statewide expansion were not as encouraging.38 In Finland, a recent intervention was unsuccessful at changing the fraction of infections that were treated with antibiotics.39 Samore et al26 reported a decrease of 9 antibiotic prescriptions per 100 person-years using a clinical decision support system in combination with a community intervention in 12 rural communities. The current trial is unique for its exclusive focus on prescribing for children, the number of nonoverlapping communities (both urban and suburban) randomized, and the ability to compare effects among Medicaid and commercially insured children.
The results of this trial should be interpreted in the context of several caveats. Our intervention addressed prescribing practices that were already undergoing substantial change, even in the absence of concerted intervention.20,40 The decreases that were seen in our control communities clearly support these trends. The overall rates of physician visits per child per year in these communities did not change during the study period. There were small decreases in respiratory illness diagnoses as a group, but these do not account for the antibiotic-use decreases that were observed in control communities. We know of no other concurrent specific programs that were promoting judicious antibiotic use in these communities; however, this intervention was undertaken on a background of initiatives of national groups (including the American Academy of Pediatrics), health plans, and attention in both professional journals and the lay press. All of these likely contributed to the decreases in prescribing that were seen in control communities. Although we believe that the approaches used here may be useful for initiatives in other content areas, additional evaluation of community-wide collaborations is needed to determine factors that are predictive of success. Our data were collected during the period of introduction of universal heptavalent pneumococcal conjugate vaccine immunization to the cohort studied. Although we do not have individual-level information on immunization status, coverage rates are high in Massachusetts and would not be expected to differ between intervention and control communities. We also recognize that Massachusetts communities, physicians, or parents may differ from those in other states; however, we point to the diversity (in size and demographic characteristics) of these communities and note that all were outside the major metropolitan areas in which tertiary hospitals, training programs, and other idiosyncrasies are likely to exert effects.
The issues of antibiotic overuse and resistance are paradigmatic of a variety of community-level health problems in which treatment decisions for individuals have aggregate impact on the community as a whole. In the era of increasing availability of automated health care data (from clinical and billing systems), the type of collaboration achieved here, of public health authorities, health plans, employers, and concerned citizens, is a potentially powerful approach for simultaneously reaching physicians and patients to improve medical care and health outcomes for populations. Future work should assess the cost-effectiveness of such community-wide approaches.
| CONCLUSIONS |
|---|
|
|
|---|
| ACKNOWLEDGMENTS |
|---|
We acknowledge the tireless work of study coordinator Jamie Kotch and educational coordinator Judith Chevarley, who were responsible for much of the intervention implementation. This study would not have been possible without the active collaboration of 4 Massachusetts health plans, Harvard Pilgrim Health Care, BlueCross and BlueShield of Massachusetts, Tufts Health Plan, and Massachusetts Medicaid, that provided data and expertise in guideline adaptation. Analysis of data from each of the participating health plans would not have been possible without the assistance of John Mason and Lisa Higgins (BlueCross and BlueShield of Massachusetts), Kimberly Lane and Ernest Shtatland (Harvard Pilgrim Health Care), Qi Zhou and Renee Altman (Tufts Health Plan), and Elaine Cox (Massachusetts Medicaid). Finally, we acknowledge our critical partnership with the Massachusetts Department of Public Health and the specific contributions of Alfred DeMaria, Director of Communicable Disease Control, and Barbara Boltsdorff.
| FOOTNOTES |
|---|
Address correspondence to Jonathan A. Finkelstein, MD, MPH, Department of Ambulatory Care and Prevention, Harvard Medical School and Harvard Pilgrim Health Care, 133 Brookline Ave, Sixth Floor; Boston, MA 02215. E-mail: jonathan_finkelstein{at}harvardpilgrim.org
Financial Disclosure: Dr Platt has received research funding since 2000 from GlaxoSmithKline, Parke Davis, Pfizer, Sanofi-Aventis, SmithKlineBeecham, Tap Pharmaceuticals, and Wyeth. The other authors have indicated they have no financial relationships relevant to this article to disclose.
Dr Finkelstein had full access to all of the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis; Drs Finkelstein, Huang, and Kleinman drafted the manuscript; Dr Kleinman and Ms Rifas-Shiman were responsible for statistical analysis; Drs Kleinman, Huang, Stille, Steingard, Soumerai, Ross-Degnan, Goldmann, and Platt, Ms Rifas-Shiman, Mr Daniel, and Ms Schiff critically reviewed the manuscript; Drs Finkelstein, Kleinman, Soumerai, Ross-Degnan, Stille, Goldmann, and Platt and Mr Daniel were responsible for study concept and design; Drs Finkelstein, Huang, Platt, and Steingard, Mr Daniel, and Ms Schiff acquired the data; and Drs Finkelstein, Huang, Kleinman, Stille, Steingard, Soumerai, Ross-Degnan, Goldmann, and Platt, Ms Rifas-Shiman, and Ms Schiff were responsible for analysis and interpretation of data.
| REFERENCES |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
C. J. Stille, S. L. Rifas-Shiman, K. Kleinman, J. B. Kotch, and J. A. Finkelstein Physician Responses to a Community-Level Trial Promoting Judicious Antibiotic Use Ann. Fam. Med, May 1, 2008; 6(3): 206 - 212. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||