ARTICLE |
a Departments of Family Medicine
b Pediatrics, University of North Carolina School of Medicine, Chapel Hill, North Carolina
c Department of Medicine, University of Chicago, Chicago, Illinois
d American Board of Medical Specialties, Evanston, Illinois
e AccessCare, Inc, Morrisville, North Carolina
f Johns Hopkins University School of Nursing, Baltimore, Maryland
g Center for Health Care Quality, Cincinnati Children's Hospital and Medical Center, Cincinnati, Ohio
| ABSTRACT |
|---|
|
|
|---|
METHODS. We used a controlled before/after study design to evaluate a quality improvement intervention in a 20-practice Medicaid network. All 20 practices participated in continuing education sessions; received free oral rehydration solution, patient education materials, and performance feedback; and participated in a follow-up conference call. Three practices were chosen to develop and pilot office-process changes. These practices formed interdisciplinary teams to develop and test changes and collaborated with project faculty and each other. They shared their learning with the other 17 practices via a conference call and toolkit. We compared before/after gastroenteritis hospital admissions for children <5 years old covered by Medicaid in the intervention practices with all other Medicaid recipients in North Carolina using claims data from 2000–2002.
RESULTS. The 3 high-intensity practices all made numerous changes to care processes. Most of the 17 low-intensity practices reported changes in their gastroenteritis care processes. Gastroenteritis admission rates declined 45% in high-intensity practices and 44% in low-intensity practices during the study compared with 11% in the control practices.
CONCLUSIONS. A practice-based, multimodal quality improvement intervention that targets multiple care processes on the basis of evidence-based guidelines lowered rates of gastroenteritis hospitalization in a Medicaid network. This approach could lower costs attributable to gastroenteritis for Medicaid programs.
Key Words: quality improvement gastroenteritis
Abbreviations: ORT—oral rehydration therapy AAP—American Academy of Pediatrics QI—quality improvement ORS—oral rehydration salts
Acute gastroenteritis is one of the most common and costly diseases among children in the United States. Each year there are
37 million cases of acute diarrhea among children <5 years old, resulting in nearly 4 million physician visits, 220000 hospitalizations, and
300 preventable deaths.1,2 The annual direct cost of care for these children is estimated to be >2 billion dollars.3,4
Evidence shows that gastroenteritis care needs improvement. The substantial geographic variation in hospitalizations for gastroenteritis suggests many hospital stays are avoidable.5,6 A recent study of childhood admissions for dehydration suggests the majority of hospitalized children could be treated in an alternative setting, such as a physician's office.7 The average cost of a gastroenteritis hospitalization is estimated to be >$2000.7
One promising strategy to improve care for gastroenteritis is increasing the appropriate use of oral rehydration therapy (ORT). ORT has many advantages over intravenous therapy, including lower cost and application in diverse settings (including a patient's home). In outpatient settings where intravenous therapy is not readily available, the decision to treat with intravenous therapy may necessitate hospitalization. ORT use in emergency departments is equivalent to intravenous therapy in improving dehydration at 2 hours, is initiated more quickly, and may decrease resultant hospitalization.8 Despite evidence-based recommendations from the American Academy of Pediatrics (AAP) and the Centers for Disease Control and Prevention, ORT is underused by US physicians.9–14 Practice-level barriers, such as the need for additional staff training and staff/physician attitudes about the inconvenience of ORT in office settings, primarily determine whether physicians routinely use ORT.11–13
Improving the quality of health care in US practices for acute clinical conditions has been challenging.15,16 Research addressing practice-based quality improvement (QI) has shown mixed results. Educational outreach visits by clinical content experts to practices has shown potential in affecting change.17–19 Peers or "local experts" were also shown to influence physician behavior more readily than traditional continuing medical education or professional society guidelines.20–22 However, multimodal strategies are more likely to be successful in changing clinical practice than single-faceted interventions.23 The purpose of this study was to examine the effect of a practice-based, multimodal QI intervention on hospital admission rates for gastroenteritis. We hypothesized that an intervention promoting evidence-based gastroenteritis guidelines that used a multimodal approach in a Medicaid managed care network could lower admission rates attributable to gastroenteritis for children.
| METHODS |
|---|
|
|
|---|
Intervention
The AccessCare network created a faculty group that included clinical experts in gastroenteritis, QI experts, and network leaders. Beginning in 2001, the network provided all 20 practices with a series of educational sessions based on evidence-based guidelines from the Centers of Disease Control and Prevention and AAP and practical aspects of ORT, a patient education video on ORT for use in waiting rooms (developed specifically for the AccessCare patient population), performance feedback on oral rehydration salts (ORS) use and admission rates for gastroenteritis, and free ORS (Pedialyte; Ross, Columbus, OH]) and generic ORS salts (World Health Organization) to distribute to patients or to use for ORT in the practice (for all patients, not solely Medicaid patients). In addition, practice-based care managers (predominantly registered nurses employed by the network) in all practices attended an educational session on ORT administration techniques and parent education delivered by project nursing faculty (Ms Edwards and Ms Powell). The application of QI strategies was not part of this baseline intervention.
In addition, the high-intensity practices participated in a 6-month long intervention from March 2001 to September 2001, which included: (1) application of multiple QI strategies (process mapping and analysis [documenting, discussing, and changing care processes]; rapid, small scale tests of changes [plan-do-study-act cycles]; and local control of improvement planning by interdisciplinary practice teams),7 and (2) collaboration between project faculty and practice improvement teams, as well as collaboration between teams. Project faculty provided: (1) education about applications of evidence-based guidelines; (2) coaching in process improvement; and (3) examples of clinical tools and prompts. The infrastructure for these interactions included: (1) a site visit by project faculty to lead the process-mapping exercise; (2) monthly conference calls for all 3 practices focusing on a clinical or process improvement topic, as well as sharing practice progress; and (3) monthly follow-up calls to each practice from project faculty (Drs Johnson and Randolph) to address practice-specific issues. Each high-intensity practice formed a "gastroenteritis improvement team" (including
1 physician, nurse, and administrative staff member). Practice improvement teams selected all changes to test and implement, as well as the sequence of changes.
After the 6-month intervention, the low-intensity practices participated in a conference call with the "gastroenteritis improvement teams" from the high-intensity practices in December 2001. The discussion was led by the high-intensity practices and facilitated by project faculty (Drs Randolph, Johnson, and Wegner and Ms Powell). The discussion focused on the successes and lessons learned in the high-intensity practices, as well as describing the use of a number of practice-based tools developed to assist with office implementation. These tools included color-coded diagrams to outline office flow for gastroenteritis patients, dehydration assessment, patient education information, and ORT instructions for clinicians and parents (tools can be found at: www.cincinnatichildrens.org/svc/alpha/h/health-quality/programs/topics/gastroenteritis.htm).
The study protocol was approved by the University of North Carolina Committee on the Protection of Rights of Human Subjects.
Outcome Measures and Data Collection
The main outcome for this study was change in the annual rate of gastroenteritis hospital admissions per 1000 Medicaid children <5 years old. We used North Carolina Medicaid claims data for calendar years 2000 to 2002 to determine each practice's gastroenteritis admission rates. Based on previous research and feedback from coders in several network practices, we used 35 International Classification of Diseases, Ninth Edition, codes to identify hospital admissions attributable to gastroenteritis (as the primary diagnosis).7 Four codes (008.61 [rotavirus], 008.8 [viral gastroenteritis], 276.5 [dehydration], and 558.9 [gastroenteritis NOS]) represented 95% of gastroenteritis admissions identified. Annual practice admissions for gastroenteritis were divided by each practice's average monthly enrollment of Medicaid children <5 years of age and multiplied by 1000 to determine admission rates. We also assessed whether high-intensity practices could make multiple process changes in their practices that were consistent with evidence-based guidelines. Process changes were documented by project staff during conference calls and by a follow-up survey after the intervention. Finally, we assessed the level of adoption of changes in the low-intensity practices using a survey of practice care managers in 2002. This survey asked practices whether they (1) had a gastroenteritis improvement team, (2) used the tools developed by high-intensity practices, and 3) were using ORT in their office.
We obtained practice characteristics, such as location and the number of Medicaid children served, from AccessCare network data. The proportion of practices with in-office intravenous therapy available at baseline (1999) was derived from an AccessCare survey of all practice care mangers in 2002. The use of ORS was measured by inventory assessments during the study.
Statistical Analysis
We used a controlled, before/after study design to compare the change in gastroenteritis hospital admission rates separately in the high- and low-intensity intervention practices and practices caring for all other Medicaid recipients in North Carolina that are not in a managed care network (control practices) by using Medicaid claims data for calendar years 2000 (preintervention) to 2002. Inferential statistics were not used because these data represent the entire Medicaid population <5 years of age from 2000 to 2002 (and thus were not a sample). Thus, no P values are reported for this outcome.
| RESULTS |
|---|
|
|
|---|
|
The 17 low-intensity practices were surveyed near the end of the study period in 2002. Forty-one percent of practices reported having a gastroenteritis improvement team, and 50% reported using
1 tool developed by high-intensity practices. Most of those not using the tools reported that they were using ORT in their office. Respondents reported that the most helpful tools were those for documentation, treatment, parent education, information on getting started, and case studies from the high-intensity practices.
All 20 intervention practices had large declines in gastroenteritis admissions during the study period (Fig 1). The high-intensity practices had an admission rate of 6.6 per 1000 in 2000. By 2002, the high-intensity practices had reduced their gastroenteritis admission rate to 3.6 per 1000, a 45% reduction. The low-intensity practices started with lower rates of admission (because of study selection criteria). In 2000, rates were 3.2 per 1000; by 2002, they had decreased to 1.8 per 1000, a 44% reduction. Control practices had admission rates of 12.2 per 1000 in 2000 and declined slightly to 10.9 per 1000 in 2002 (11% reduction).
|
| DISCUSSION |
|---|
|
|
|---|
To our knowledge, only 1 study has assessed the effectiveness of an intervention addressing practice barriers to effective gastroenteritis care in primary care practices. Duggan and colleagues24 demonstrated that a simple intervention in community practices (giving free ORS with instructions to parents at acute diarrhea visits) could reduce gastroenteritis-related health care use. However, because systematic reviews and recent randomized, controlled trials of interventions to change physician practice here demonstrated that multimodal approaches are more effective than focused approaches, we used a multimodal approach.19,25,26
Practice-based QI interventions have demonstrated mixed success. In a recent systematic review, Shortell and colleagues27 reported that QI interventions were more likely to be successful if they (1) involved a nucleus of physicians, (2) provided specific feedback, and (3) provided a supportive organization structure.27 Several recent trials have shown success in QI implementation in practice-based settings for chronic conditions and preventive care. Common themes in successful programs include local implementation under flexible conditions consistent with typical practice environments and the use of small-scale tests of change to frequently reinforce practice success.28–30 The current study adds to this literature in demonstrating the success of a QI intervention capitalizing on similar components applied to an acute condition.
We attribute the success of the intervention to several key features, which may be important for effective QI initiatives in primary care practices. The intervention was the practice-based, multimodal effort, not the specific changes implemented (the result of this intervention). Any attempt to replicate this intervention should focus on the practice-based, multimodal design (eg, peer-to-peer teaching) rather than on the exact changes made by the practices. Giving control to those intimately involved in a system's processes is a long-standing QI principle with proven success.28,31,32 Most of the specific changes implemented in our study originated from practice teams, not from project faculty. Other key design features included collaboration between faculty experts and practices, peer-to-peer teaching, sharing of evidence-based tools developed locally, provision of resources (eg, patient education videos and ORS) by network leadership, performance feedback, and principles of academic detailing.18,20,33
Academic detailing, the use of clinical expert outreach visits to physician practices, has been repeatedly shown to improve provider knowledge. A recent meta-analysis showed positive effects on practices in all studies reviewed. The change in gastroenteritis admissions by the low-intensity practices was surprising because this intervention was more limited and admission rates were already low. In fact, gastroenteritis admission rates declined by 28% before the peer-to-peer conference calls and an additional 22% after peer-to-peer teaching. This demonstrates the significant success of this less intensive intervention. Although it is possible that the high-intensity intervention did not have any additional effect, we speculate that the impact of the peer-to-peer teaching and tools provided by the high-intensity practices may have helped the low-intensity practices achieve similar results and improve sustainability. By sharing lessons learned, the high-intensity practices reinforced their own improvements and the representatives served as opinion leaders. Physicians and their practices are more likely to adopt new strategies after learning of the proven success of their peers.21,34 The use of local opinion leaders as peer teachers in QI interventions has shown mixed success.
Our study has several limitations. Data collected for this study were aggregate practice-level data rather than patient-level data. Such data are best used for addressing plausibility of a hypothesis or hypothesis generation rather than assessing causality.35 For example, we do not know whether patients admitted for gastroenteritis received ORT. Future studies including patient-level data would strengthen the causal link between this intervention and reduced hospitalizations. Also, we did not collect data on adverse events in this project, because the primary purpose was for QI, and the intervention was based on established evidence-based guidelines. Intervention practices differed from control practices in their Medicaid population size, specialty mix, and baseline admission rates. Differences is specialty practice patterns, staffing, local hospitals, and Medicaid population or practice size may explain the differences between baseline intervention and control practice admission rates. The current study cannot control for these differences. Future studies should attempt to include a more comparable control group. Also, unequal distribution of gastroenteritis outbreaks may have affected the results. We are unaware of any such factors. Among the control practices, a temporal decline in gastroenteritis admissions was observed. This may be because of secular improvements in practice patterns, financial incentives to keep patients out of the hospital, or because of declines in gastroenteritis severity during the study years. However, the relative reduction in admissions was small in the control group compared with the reductions in the intervention practices. Finally, because of the selection of intervention practices, this study may not be generalizable to smaller practices, patients not covered by Medicaid, or family medicine, general practice, or multi-specialty practices.
| CONCLUSIONS |
|---|
|
|
|---|
To date, QI interventions have largely been applied to chronic conditions or preventive services. Our study offers an example of a QI intervention to improve care for gastroenteritis and could serve as a model to improve care of other acute care conditions in primary care practices.
| ACKNOWLEDGMENTS |
|---|
We thank the creative and dedicated physicians, nurses, and staff who participated in the high-intensity intervention from Kinston Pediatric Associates, Mountain View Pediatrics, and Sandhills Pediatrics. In particular, we thank improvement team members Shantel Carter, Susan Freeman, Orville Reece, MD, and Candace Smith (Kinston Pediatric Associates); Julie Causby, Christi Ferraro, Melissa Jones, Karen Lail, Rudy Medina, MD, John Whalley, MD, Terri Rhyder, and Connie Williams (Mountain View Pediatrics); and Anna Carpenter, Debbie Cruse, Elaine Hines, Amy Ivey, Cate Mason, MD, Jean McClendon, Beth O'Connor, Paulette Royal, Cindy Shamburger, Jamie Smith, and William Stewart, MD (Sandhills Pediatrics). We also thank Marcelletta Miles, RN, BSN, from the AccessCare, Inc, network for vision and leadership. In addition, we thank Julius Goepp, MD, and Larry Nazarian, MD, for sharing their clinical knowledge and invaluable experiences during the project. Finally, we are indebted to Clay Bordley, MD, MPH, and Peter Margolis, MD, PhD, for insightful comments to improve this manuscript.
| FOOTNOTES |
|---|
Address correspondence to Adam J. Zolotor, MD, MPH, University of North Carolina, Department of Family Medicine, CB#7595, Chapel Hill, NC 27599-7595. E-mail: ajzolo{at}med.unc.edu
Preliminary results from this study were presented as a platform presentation at the Ambulatory Pediatrics Association meeting; May 4, 2002; Baltimore, MD.
The authors have indicated they have no financial relationships relevant to this article to disclose.
| REFERENCES |
|---|
|
|
|---|
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||