ARTICLE |
a Department of Medicine, Children's Hospital Boston, Harvard Medical School, Boston, Massachusetts
b Robert Wood Johnson Foundation Clinical Scholar Program
c Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia, Pennsylvania
d Department of General Pediatrics, Children's Hospital of Philadelphia, Philadelphia, Pennsylvania
e Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts
f Children's Hospital and Health Center, University of California, San Diego, School of Medicine, San Diego, California
g Children's National Medical Center, George Washington University School of Medicine, Washington, DC
| ABSTRACT |
|---|
|
|
|---|
METHODS. A national survey was administered to hospitalists and a random sample of community pediatricians. Hospitalists and community pediatricians reported their frequency of use of diagnostic tests and therapies, on 5-point Likert scales (ranging from never to almost always), for common inpatient pediatric illnesses. Responses were compared in univariate and multivariable logistic regression analyses controlling for gender, race, years out of residency, days spent attending per year, hospital practice type, and completion of fellowship/postgraduate training.
RESULTS. Two hundred thirteen pediatric hospitalists and 352 community pediatricians responded. In multivariable regression analyses, hospitalists were significantly more likely to report often or almost always using the following evidence-based therapies for asthma: albuterol and ipratropium in the first 24 hours of hospitalization. After the first urinary tract infection, hospitalists were more likely to report obtaining the recommended renal ultrasound and voiding cystourethrogram. Hospitalists were significantly more likely than community pediatricians to report rarely or never using the following therapies of unproven benefit: levalbuterol, inhaled steroid therapy, and oral steroid therapy for bronchiolitis; stool culture and rotavirus testing for gastroenteritis; and ipratropium after 24 hours of hospitalization for asthma.
CONCLUSION. Overall, in comparison with community pediatricians, hospitalists reported greater adherence to evidence-based therapies and tests in the care of hospitalized patients and less use of therapies and tests of unproven benefit.
Key Words: pediatrics hospitalist variability variation evidence-based medicine health services research inpatient
Abbreviations: AAPAmerican Academy of Pediatrics AMAAmerican Medical Association BMJBritish Medical Journal SHMSociety of Hospital Medicine UTIurinary tract infection ORodds ratio CIconfidence interval
In 1996, Wachter and Goldman1 coined the term "hospitalist" for physicians focusing on the care of hospitalized patients. The Society of Hospital Medicine (SHM) membership grew from <100 to >4000 between 1997 and 2004,2 and the SHM estimates that nearly twice as many hospitalists may be in practice.3,4 Eight percent of SHM members, or
300, are pediatric hospitalists; a recent pediatric hospitalist conference attracted >200 attendees (D. Rauch, verbal communication, 2005). No formal counts have been made, but there are likely 500 to 2000 pediatric hospitalists in practice today.5
Pediatric hospitalist systems were found in 6 of 7 studies to decrease lengths of stay and inpatient costs, but data on the quality of care are lacking.612 Although 2 adult studies found decreased mortality rates in hospitalist systems,13,14 the processes of care that led to the mortality rate decreases were not studied. No studies in pediatric ward settings demonstrated mortality rate differences, although they all were underpowered to do so.69 Because death in pediatric inpatient ward settings is uncommon, more-sensitive indicators of care quality are required to measure the effectiveness of a care system and its providers. No studies have investigated potential differences in care provided by hospitalists and community pediatricians. Measuring the processes of care delivery, such as the consistency with which providers follow evidence-based practices and national guidelines, is one means of measuring quality more precisely. To compare the quality of care delivered in hospitalist and traditional systems, we undertook a nationwide survey to compare hospitalists' and community pediatricians' reported use of evidence-based therapies in the care of common inpatient conditions.
| METHODS |
|---|
|
|
|---|
The refined survey was administered to the entire population of pediatric hospitalists identified nationally through 3 known mechanisms to reach pediatric hospitalists, namely, (1) a national listserv for pediatric hospitalists sponsored by the SHM and the American Academy of Pediatrics (AAP) Section on Hospital Medicine, (2) the Pediatric Research in Inpatient Settings network listserv, and (3) the attendance list from the first national pediatric hospitalist conference, held in San Antonio, Texas, in November 2003. Hospitalists identified through >1 of these sources were counted only once; in total, there were 320 identified pediatric hospitalists. Respondents had the option of completing the survey online, using a secure, Internet-based interface, or on paper. Regular reminder notices and additional copies of surveys were sent to all nonresponders. Respondents were excluded if they did not practice primarily as hospitalists.
A comparison group of community pediatricians were administered the same questions in September 2004. From the American Medical Association (AMA) nationwide list of 41358 office-based primary care pediatricians, 2500 randomly selected pediatricians were invited to participate. The number of invitations was based on a power calculation that indicated that at least 200 respondents would be necessary to detect significant differences in the responses of pediatricians and hospitalists, with a target 8% response rate. The Medical Marketing Services listserv managers of the AMA reported participation rates of 2% to 5% in similar national surveys with their database (M. L. Walters, verbal communication, 2004), but we hoped to achieve a somewhat higher response rate by minimizing the length of the survey. Three weeks after the first mailing, the survey was mailed a second time to all nonresponders. Respondents had the option of completing the survey online, using a secure, Internet-based interface, or on paper. Survey respondents were included only if they worked primarily as primary care pediatricians and had served as the attending physician of record for
1 hospitalized pediatric patient (excluding well newborns) in the past 12 months. Community pediatricians were asked identical questions regarding demographic features, practice setting, training background, and management of common inpatient pediatric conditions. Community pediatricians were asked specifically to report their use of diagnostic tests and therapies for hospitalized patients only and not to report their outpatient management practices.
To determine differences in compliance with evidence-based practices between hospitalists and community pediatricians, the British Medical Journal (BMJ) publication Clinical Evidence was used to identify therapies proven to be beneficial.15 Three therapies with proven benefit in treating hospitalized asthmatic children were identified, namely, steroids, albuterol, and ipratropium in the first 24 hours. To determine adherence to AAP clinical practice guidelines, the AAP guideline recommending a renal ultrasound and a voiding cystourethrogram after the first UTI in infants was selected.16 We then defined the evidence-based response for use of these proven therapies and nationally recommended tests as respondents reporting use often or almost always.
Next, BMJ Clinical Evidence was searched to identify therapies of unproven benefit, on the basis of the BMJ designation of the treatment in the "unknown effectiveness" category. Four therapies of unproven benefit for bronchiolitis (levalbuterol, inhaled steroid therapy, oral steroid therapy, and albuterol) and 1 therapy of unproven benefit for asthma (ipratropium after 24 hours of hospitalization) were identified.15 AAP-endorsed clinical practice guidelines were searched to identify tests that were not recommended routinely because of unproven benefit. Gastroenteritis management was the only applicable AAP guideline, recommending against obtaining stool cultures or performing rotavirus testing for routine gastroenteritis.17,18 The evidence-based response for these 7 unproven tests and therapies was defined as reporting use never or rarely. The other 36 therapies and tests included on the questionnaire were not classified specifically as being either of proven benefit or of unknown effectiveness in the BMJ of Clinical Evidence, and explicitly defined recommendations in AAP practice guidelines did not exist. Therefore, there was no evidence-based response defined for these therapies and tests; variability between hospitalists and community pediatricians was measured, but no judgments about the evidence underlying these management choices were made.
Hospitalists' and community pediatricians' uses of tests and therapies were compared by using the Wilcoxon rank sum test for all 48 therapies and tests. For the 12 therapies and tests with an evidence base, univariate analyses (Fisher's exact tests) were conducted to compare the percentages of hospitalists and community pediatricians reporting compliance with the evidence-based response for each therapy. Univariate relationships with the following factors hypothesized a priori to correlate possibly with reported management decisions were also determined: completion of fellowship/postgraduate training, days attending per year, years out of residency, and hospital practice type. For days attending per year, high-volume practitioners (defined as those attending >90 days per year) were compared with low-volume practitioners. For years out of residency, pediatricians
10 years out of residency were compared with pediatricians
11 years out of residency. Hospital practice type compared pediatricians in an academic center setting with those in a community hospital setting. To test more thoroughly the principal hypothesis regarding hospitalists' use of evidence-based and unproven therapies, multivariable logistic regression analyses controlling for gender, race, days attending per year, years out of residency, hospital practice type, and completion of additional fellowship or graduate training were conducted for each therapy or diagnostic test of interest.
| RESULTS |
|---|
|
|
|---|
|
|
|
|
| DISCUSSION |
|---|
|
|
|---|
To our knowledge, this is the first study to indicate that the quality-of-care processes in hospitalist systems may differ from those in traditional care systems. Two previous adult studies demonstrated decreased mortality rates in hospitalist systems, but the mechanisms through which such improvements were achieved were not clear.13,14 In pediatric ward settings, no studies have demonstrated differences in mortality rates or quality-of-care processes in hospitalist systems, compared with traditional systems.58 The differences in inpatient care processes we identified also suggested a mechanism through which hospitalists may achieve cost savings in hospital care, beyond those associated with decreased length of stay; hospitalists' decreased use of therapies and tests of unproven benefit likely yields cost savings because of reductions in unnecessary laboratory and pharmacy use.6,7,9,11
There are several limitations to this study. The first limitation is that the study is based on self-reporting of clinical decisions, which may not represent actual practice; true compliance with evidence-based guidelines may be less than that reported by providers. There is little reason to postulate, however, that hospitalists and community pediatricians would differ significantly in the accuracy of their self-reports. It is likely that, if evidence-based practices are known, then the 2 groups would have similar tendencies to overreport their compliance. The second limitation is that adherence to practice guidelines is only a proxy for quality of care and practice guidelines can change over time or can be called into question. Specifically, the utility of a renal ultrasound after the first UTI was called into question by Hoberman et al19 in 2003, and pediatricians' reports of not obtaining renal ultrasound scans might be based on this new evidence. However, we needed to define evidence-based practices on the basis of sources that summarize the literature, and AAP clinical practice guidelines and BMJ Clinical Evidence are generally accepted sources of evidence-based practice guidelines. A third limitation is the possibility that our sample of community pediatricians was not representative of pediatricians throughout the nation. Because pediatric hospitalists as a group have been highly motivated to participate in inpatient pediatric research, we anticipated and achieved a high response rate for that group. We did not expect to achieve such a high response rate from the random nationwide sample of community pediatricians, especially given the Medical Marketing Service historical response rates of 2% to 5% for national surveys administered to a random sample of providers.16 Although a response rate of 15% exceeded our expectations, selection bias might have occurred. We think, however, that the effect of such a bias would likely have been to minimize differences between the groups, because of selection for a cohort of community pediatricians interested in a study of inpatient care management and confident in their treatment of inpatients. In addition, although the proportion of pediatrician respondents was small, the respondents seemed to be similar demographically to the AMA nationwide list of pediatricians.
Previous studies demonstrated improved outcomes for patients cared for by subspecialists, with more experience and higher patient volume, in areas such as pediatric cardiac surgery, neonatal intensive care, and pediatric oncology.2024 In addition, studies of specialist versus generalist care without a specific focus on patient volume demonstrated improved outcomes with specialists for diseases as diverse as depression, allergic rhinitis, and heart failure.2527 Hospitalists both specialize in inpatient pediatrics and attend a greater number of inpatients per year, and this study suggests that this expertise leads to greater adherence to evidence-based therapies. The correlation between reported management decisions and outcomes needs to be demonstrated and should be a focus of additional research. The AAP Section on Hospital Medicine endorsed this need to measure outcomes in their recently published report.28
A fundamental problem in inpatient pediatric medicine is the lack of a robust evidence base regarding the optimal treatment of many common inpatient illnesses. Many of these conditions have been investigated only in relatively small studies without the necessary power to measure differences in mortality rates or subtler but clinically important effects of commonly used therapies. Research networks such as the Pediatric Research in Inpatient Settings Network have the potential to address these knowledge gaps through multicenter studies of inpatient care and coordination of research efforts. Hospitalist models have emerged as potentially beneficial models of care delivery,24,13 but extensive work is needed to more effectively measure and improve the quality of inpatient care.
| ACKNOWLEDGMENTS |
|---|
We thank Dr Frederick Lovejoy for his support of this research and Daniel Kinnamon for his help with statistical analysis. We also acknowledge Mary Lou Walters of Medical Marketing Services for help in identifying relevant community pediatricians and Bruce Sprague for online survey design and management.
| FOOTNOTES |
|---|
Address correspondence to Patrick H. Conway, MD, Robert Wood Johnson Clinical Scholars Program, University of Pennsylvania, 423 Guardian Dr, Blockley Hall, 1303A, Philadelphia, PA 19104. E-mail: pconway{at}cceb.upenn.edu
The authors have indicated they have no financial relationships relevant to this article to disclose.
| REFERENCES |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
S. Inoue Evidence-Based Medicine Practice by Hospitalists and Community Pediatricians Pediatrics, April 1, 2007; 119(4): 863 - 864. [Full Text] [PDF] |
||||
![]() |
J. Percelay and M. B. Pate Inpatient Management by Hospitalists versus Community Pediatricians AAP Grand Rounds, February 1, 2007; 17(2): 17 - 18. [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||