Skip to main content

Advertising Disclaimer »

Main menu

  • Journals
    • Pediatrics
    • Hospital Pediatrics
    • Pediatrics in Review
    • NeoReviews
    • AAP Grand Rounds
    • AAP News
  • Authors/Reviewers
    • Submit Manuscript
    • Author Guidelines
    • Reviewer Guidelines
    • Open Access
    • Editorial Policies
  • Content
    • Current Issue
    • Online First
    • Archive
    • Blogs
    • Topic/Program Collections
    • AAP Meeting Abstracts
  • Pediatric Collections
    • COVID-19
    • Racism and Its Effects on Pediatric Health
    • More Collections...
  • AAP Policy
  • Supplements
    • Supplements
    • Publish Supplement
  • Multimedia
    • Video Abstracts
    • Pediatrics On Call Podcast
  • Subscribe
  • Alerts
  • Careers
  • Other Publications
    • American Academy of Pediatrics

User menu

  • Log in
  • Log out
  • My Cart

Search

  • Advanced search
American Academy of Pediatrics

AAP Gateway

Advanced Search

AAP Logo

  • Log in
  • Log out
  • My Cart
  • Journals
    • Pediatrics
    • Hospital Pediatrics
    • Pediatrics in Review
    • NeoReviews
    • AAP Grand Rounds
    • AAP News
  • Authors/Reviewers
    • Submit Manuscript
    • Author Guidelines
    • Reviewer Guidelines
    • Open Access
    • Editorial Policies
  • Content
    • Current Issue
    • Online First
    • Archive
    • Blogs
    • Topic/Program Collections
    • AAP Meeting Abstracts
  • Pediatric Collections
    • COVID-19
    • Racism and Its Effects on Pediatric Health
    • More Collections...
  • AAP Policy
  • Supplements
    • Supplements
    • Publish Supplement
  • Multimedia
    • Video Abstracts
    • Pediatrics On Call Podcast
  • Subscribe
  • Alerts
  • Careers

Discover Pediatric Collections on COVID-19 and Racism and Its Effects on Pediatric Health

American Academy of Pediatrics
Article

Variation in Emergency Department Diagnostic Testing and Disposition Outcomes in Pneumonia

Todd A. Florin, Benjamin French, Joseph J. Zorc, Elizabeth R. Alpern and Samir S. Shah
Pediatrics August 2013, 132 (2) 237-244; DOI: https://doi.org/10.1542/peds.2013-0179
Todd A. Florin
Divisions of aEmergency Medicine and
bUniversity of Cincinnati College of Medicine, Cincinnati, Ohio;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Benjamin French
cDepartment of Biostatistics and Epidemiology, Perelman School of Medicine at the University of Pennsylvania and Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia, Pennsylvania; and
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Joseph J. Zorc
dDivision of Emergency Medicine, The Children’s Hospital of Philadelphia, Perelman School of Medicine at the University of Pennsylvania, Philadelphia, Pennsylvania
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Elizabeth R. Alpern
dDivision of Emergency Medicine, The Children’s Hospital of Philadelphia, Perelman School of Medicine at the University of Pennsylvania, Philadelphia, Pennsylvania
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Samir S. Shah
bUniversity of Cincinnati College of Medicine, Cincinnati, Ohio;
eHospital Medicine and Infectious Diseases, Cincinnati Children’s Hospital Medical Center, Cincinnati, Ohio;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • Supplemental
  • Info & Metrics
  • Comments
Loading
Download PDF

Abstract

OBJECTIVE: To describe the variability across hospitals in diagnostic test utilization for children diagnosed with community-acquired pneumonia (CAP) during emergency department (ED) evaluation and to determine if test utilization is associated with hospitalization and ED revisits.

METHODS: We conducted a retrospective cohort study of children aged 2 months to 18 years with ED visits resulting in CAP diagnoses from 2007 to 2010 who were seen at 36 hospitals contributing data to the Pediatric Health Information System. Children with complex chronic conditions, recent hospitalization, trauma, aspiration, or perinatal infection were excluded. Primary outcomes included diagnostic testing, hospitalization, and 3-day ED revisit rates across hospitals. We examined variation in diagnostic testing among hospitals by using multivariable mixed-effects logistic regression.

RESULTS: A total of 100 615 ED visits were analyzed. Complete blood count (median: 28.7%), blood culture (27.9%), and chest radiograph (75.7%) were the most commonly ordered ED diagnostic tests. After adjustment for patient characteristics, significant variation (P < .001) was found for each test examined across hospitals. High test-utilizing hospitals had increased odds of hospitalization compared with low-utilizing hospitals (odds ratio: 1.86 [95% confidence interval: 1.17–2.94]; P = .008). However, differences in the odds of ED revisit between the low- and high-utilizing hospitals were not significant (odds ratio: 1.21 [95% confidence interval: 0.97–1.51]; P = .09).

CONCLUSIONS: Emergency departments that use more testing in diagnosing CAP have higher hospitalization rates than lower-utilizing EDs. However, ED revisit rates were not significantly different between high- and low-utilizing EDs. These results suggest an opportunity to reduce diagnostic testing for CAP without negatively affecting outcomes.

  • children
  • clinical practice variation
  • diagnostic tests
  • emergency medicine
  • health resources
  • health services research
  • hospitalization
  • logistic models
  • physician practice patterns
  • pneumonia
  • radiography
  • utilization
  • Abbreviations:
    APR-DRG —
    All Patient Refined Diagnosis Related Group
    CAP —
    community-acquired pneumonia
    CBC —
    complete blood count
    CHA —
    Children’s Hospital Association
    CT —
    computed tomography
    ED —
    emergency department
    ICD-9-CM —
    International Classification of Diseases, Ninth Revision, Clinical Modification
    LOS —
    length of stay
    PHIS —
    Pediatric Health Information System
  • What’s Known on This Subject:

    There is wide variation in testing and treatment of children hospitalized with pneumonia. Limited data are available on diagnostic testing patterns and the association of test utilization with disposition outcomes for children with pneumonia evaluated in the emergency department (ED).

    What This Study Adds:

    Significant variation exists in testing for pediatric pneumonia. EDs that use more testing have higher hospitalization rates. However, ED revisit rates were not significantly different between high- and low-utilizing EDs, suggesting an opportunity to reduce testing without negatively affecting outcomes.

    Community-acquired pneumonia (CAP) is the most common serious bacterial infection in children.1–5 Despite its high incidence and morbidity, there is a paucity of data regarding the ability of laboratory testing to diagnose pneumonia, differentiate etiology, and predict clinical course.6 For example, although white blood cell count and C-reactive protein are 2 commonly obtained laboratory markers obtained in pediatric infection, they have only fair specificity and poor sensitivity in the diagnosis of bacterial pneumonia; the degree of elevation does not distinguish bacterial from viral infection.7,8 There is wide variability in hospitalization rates and diagnostic testing among hospitalized children with CAP, highlighting the fact that with this lack of evidence comes the potential for variation in resource utilization.9–11

    Studies in adults with CAP suggest that despite widely variable processes between hospitals and providers, outcomes do not differ substantially.12–14 Pediatric studies in other diseases also have demonstrated variation in emergency department (ED) testing that is associated with increased resource utilization, including hospital admission.15,16 Although 2 previous studies have documented variation in chest radiography and antibiotic utilization in the ED for CAP,17,18 no studies, to our knowledge, have examined the association between diagnostic testing and ED disposition decisions. The objectives of the current study were to describe the variability across hospitals in diagnostic test utilization for children presenting to the ED with CAP and to determine if test utilization is associated with the disposition decision.

    Methods

    Study Design and Data Source

    This multicenter, retrospective cohort study included ED visits of children diagnosed with CAP. Data were from the Pediatric Health Information System (PHIS), an administrative database of 43 not-for-profit, tertiary care pediatric hospitals in the United States affiliated with the Children’s Hospital Association (CHA; Shawnee Mission, KS). Data quality and reliability are assured through a joint effort between CHA and participating hospitals. Hospitals provide discharge/encounter data, including demographic characteristics, procedures, and diagnoses in International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM), format; 42 of these hospitals also submit resource utilization data (eg, pharmaceuticals, imaging, laboratory). Data are de-identified, but encrypted medical record numbers permit identification of patients across multiple visits to the same hospital.19 The current study excluded 6 hospitals because ED or resource utilization data were not available, leaving 36 hospitals in our cohort. This study was reviewed and approved by the institutional review board of The Children’s Hospital of Philadelphia.

    Study Population

    Inclusion Criteria

    Patients between 2 months and 18 years of age who were diagnosed with CAP from July 1, 2007, to June 30, 2010, were eligible for inclusion. If patients had multiple visits for CAP in a 28-day period, only the initial visit was included to best capture the utilization on initial presentation for each single episode of CAP. To minimize within-patient clustering, if a patient had multiple distinct episodes of CAP resulting in multiple visits for pneumonia over the 3-year study period, a single initial visit, representing a distinct episode of CAP, was randomly selected for inclusion. Overall, 90.7% of patients had a single visit in the study period, 7.9% had 2 visits, and 1.4% had ≥3 visits.

    Definition of Pneumonia

    A previously validated algorithm was used to identify patients with CAP.20,21 Patients were considered to have CAP if they met either of the following criteria: an ICD-9-CM primary diagnosis code indicating pneumonia (codes 480–483 and 485–486), empyema (510), or pleurisy (511.0, 511.1, or 511.9) or a primary diagnosis of a pneumonia-related symptom ICD-9-CM code (eg, fever, cough) (Supplemental Information 4) and a code for pneumonia, empyema, or pleurisy in any other diagnosis position.20

    Exclusion Criteria

    Patients with complex chronic conditions, as defined by Feudtner et al,22 were excluded because these patients may have unmeasured covariates not reflective of the general population and may therefore warrant a different approach. To exclude patients with hospital-acquired pneumonia, we excluded patients hospitalized within 30 days preceding the ED visit. We also excluded patients with codes indicating trauma (518.5, 800–999) or aspiration pneumonitis (506–508). To minimize the inclusion of patients with perinatally acquired and neonatal hospital-acquired infections, we excluded patients with diagnoses associated with pregnancy and delivery (640–679, 760–779). Patients seen initially at another institution and directly transferred were also excluded because they may have had testing performed before arrival.

    Diagnostic Testing

    Laboratory measures included complete blood count (CBC), blood chemistries, inflammatory markers (C-reactive protein and erythrocyte sedimentation rate), coagulation studies, viral studies, and blood cultures. Imaging studies included chest radiography, ultrasonography, and computed tomography (CT) scans. All tests were determined with PHIS-specific Clinical Transaction Classification codes. Only measures obtained on the first hospital day were included in the analyses to capture those tests performed in the ED.

    Outcome Measures

    Outcomes included hospital-level rates of variation in diagnostic testing, hospital admission rate on initial ED visit, and ED revisit rate within 3 days after the index ED visit in those initially discharged. As a secondary analysis, we examined the hospital length of stay (LOS) in those patients who were initially admitted. A short LOS was defined as ≤2 days.

    Covariates

    Patient-level covariates included age, gender, race/ethnicity, primary source of payment, and admission season and year. Hospital-level covariates included geographic location, average hospital daily census, ED annual volume, percent uninsured, and severity. Hospital-level severity was determined by generating an average of each hospital’s All Patient Refined Diagnosis Related Group (APR-DRG) severity score for all patients seen at that hospital during the study period. APR-DRG severity scores represent illness severity and risk of death for hospitalized patients.23 Because these scores are not validated for outpatients, we did not apply them at the ED visit level but rather used them at the hospital level as a proxy for overall hospital severity of illness for all diagnoses.

    Statistical Analysis

    To explore variation across hospitals in diagnostic testing, unadjusted distributions for each test were determined by calculating the rate of subjects at each hospital who received the test and summarizing these rates across hospitals. Adjusted rates were obtained by adjusting hospital-level testing rates for patient-level characteristics; we used a mixed-effects logistic regression model for the subject-level binary outcome of test use (eg, blood cultures, yes/no), adjusted for patient age, race/ethnicity, year and season of presentation, and insurance status, with hospital-specific random intercepts. Each random intercept represented the degree to which a hospital’s test use departed from what would be expected, on average, for a hospital with a similar case mix. This model was used to estimate population-averaged rates of testing expected at each hospital based on its patients’ characteristics. These expected rates were compared with observed rates at each hospital, and an adjusted rate was obtained by standardizing the unadjusted rate by this ratio of observed to expected rates of testing.24

    Hospitals that were high or low utilizers of testing were identified by detecting outliers in the random effects distribution.25 A mixed-effects logistic regression model was fit for each diagnostic test with hospital-specific random intercepts. For each hospital, a test statistic was calculated as the ratio of the estimated random intercept to its estimated SE. Each hospital was assigned a rank from low to high based on ascending values of this statistic for each test. Pairwise Pearson correlation coefficients of these ranks were determined to explore the correlation between the utilization of tests. The sum of ranks across tests was obtained for each hospital, and an overall utilization rank was assigned. Hospitals with ranks in the upper tertile were defined as “high” utilizers, and those in the lowest tertile were defined as “low” utilizers.

    Mixed-effects logistic regression models with hospital-specific random intercepts were used to determine the association of test utilization with each binary outcome for patient disposition. In these models, utilization of each test was decomposed into a within-hospital and between-hospital term. By simultaneously estimating the effects associated with average hospital-level utilization and patient-level utilization, we avoided the potential for ecological bias resulting from assuming a single aggregate utilization measure.26 Finally, mixed-effects logistic regression models were built with utilization tertile as the primary independent variable to examine the association of overall utilization with disposition outcome.

    To account for potentially important confounders not included in the analyses, several sensitivity analyses were performed. Because APR-DRG severity scores cannot be accurately used for individual ED patient visits, we used the average of APR-DRG severity scores for all patients seen at each hospital as a proxy for hospital-level overall severity and examined these across hospitals. To assess the potential association between severity and utilization, a linear regression model, including overall hospital APR-DRG score and utilization tertile, was used. Because patients with asthma or bronchiolitis may warrant a different management approach, we repeated analyses excluding these patients. A sensitivity analysis was also performed to assess the extent to which an unmeasured factor could alter the results.27

    All analyses were performed by using Stata 12.1 (Stata Corp, College Station, TX). Graphics were generated by using R 2.15.0 (R Foundation for Statistical Computing, Vienna, Austria).

    Results

    During the study period, 100 615 ED visits for CAP were eligible for inclusion across the 36 hospitals. The median age was 3 years (interquartile range: 1–6). Fifty-four percent of subjects were male. Thirty-four percent of patients were non-Hispanic white, 27% were non-Hispanic black, and 20% were Hispanic. Forty percent of patients had government insurance. Thirty-six percent of ED visits occurred in winter. Twenty-six percent of the subjects were hospitalized initially; 6.4% of patients initially discharged from the ED returned to the ED within 3 days (Supplemental Information 5).

    Variation in Diagnostic Testing

    Unadjusted and adjusted summary statistics for each diagnostic test are presented in Table 1. CBC, blood culture, and chest radiograph were the most frequently ordered tests. Significant variation was found between hospitals for each diagnostic test in both unadjusted and adjusted analyses. After adjustment for patient characteristics, CBC, blood culture, and inflammatory markers demonstrated the broadest range of variation across hospitals.

    View this table:
    • View inline
    • View popup
    TABLE 1

    ED Utilization of Diagnostic Tests for CAP Across 36 PHIS Hospitals

    Hospital-Level Utilization of Diagnostic Testing

    Figure 1 illustrates both the individual utilization ranking for each test according to hospital and overall utilization tertiles by using the sum of the ranks. Hospitals with high overall utilization were often high utilizers of multiple individual tests, as indicated by the darker shaded boxes. The most highly correlated tests were CBC with blood culture (r = 0.83) and CBC with chemistries (r = 0.78).

    FIGURE 1
    • Download figure
    • Open in new tab
    • Download powerpoint
    FIGURE 1

    Diagnostic test utilization by hospital. For each diagnostic test listed on the horizontal axis, hospitals were ranked according to their utilization (see the Statistical Analysis section). A shaded box represents the utilization rank for each hospital; darker shading indicates higher utilization. For each hospital, overall utilization was calculated as the sum of utilization ranks across diagnostic tests. Hospitals were ordered according to their overall utilization rank, from low to high, on the left vertical axis. Tertiles of overall utilization were used to classify overall utilization as low, moderate, or high (as indicated on the right vertical axis). CRP, C-reactive protein; CXR, chest radiograph; ESR, erythrocyte sedimentation rate; US, ultrasound.

    Utilization of Diagnostic Testing and Patient Disposition

    With the exception of chest radiography, all diagnostic tests were highly associated with increased odds of hospitalization (Table 2). The highest odds of hospitalization were seen with ultrasound, CT, coagulation studies, CBC, and chemistries. Receipt of CBC, blood culture, chemistries, and inflammatory markers on initial ED visit were all associated with ED revisit and subsequent hospitalization within 3 days.

    View this table:
    • View inline
    • View popup
    TABLE 2

    Adjusted Mixed-Effects Logistic Regression: Association of Utilization With Hospitalization and ED Revisit

    As overall utilization rank increased, the rate of hospitalization increased (Fig 2). Hospitalization rate ranged from 17.6% to 67.6% in the high-utilization tertile compared with 10.4% to 38.2% in the low-utilization tertile. In mixed-effects regression analyses, high-utilizing hospitals had an 86% increased odds of hospitalization compared with low-utilizing hospitals (Table 3). For patients hospitalized, there was no difference in the odds of a short LOS in the high-utilization tertile compared with the low-utilization tertile (odds ratio: 0.96 [95% confidence interval: 0.78–1.17]; P = .7).

    FIGURE 2
    • Download figure
    • Open in new tab
    • Download powerpoint
    FIGURE 2

    Overall utilization and disposition outcomes. Individual hospitals are represented by shaded circles; darker shading indicates increased overall utilization. A, Hospitalization rate according to overall utilization. B, Three-day ED revisit rate according to overall utilization.

    View this table:
    • View inline
    • View popup
    TABLE 3

    Overall Utilization and Association With Hospitalization and ED Revisit

    The rate of ED revisit within 3 days, however, was similar between low-utilizing (range: 5.3%–10.5%) and high-utilizing (range: 5.3%–11.1%) EDs. There was no significant difference in the odds of ED revisit between the low- and high-utilization tertiles.

    Sensitivity Analyses

    To examine overall hospital-level severity, we examined average APR-DRG severity scores across hospitals and found that the average APR-DRG severity scores, which ranged from 1 (least severe) to 4 (most severe), ranged from 1.1 to 1.35 across all hospitals in our cohort. In addition, there was no association between utilization tertile and overall hospital APR-DRG severity score (low-utilization, reference group; medium-utilization coefficient: 0.03, P = .2; high-utilization coefficient: 0.04, P = .1). There was no difference in the results when patients with asthma and bronchiolitis were excluded. Several scenarios to evaluate the impact of an unmeasured confounder were examined. Assuming that the prevalence of the unmeasured confounder was 50% greater in high-utilizing hospitals compared with low-utilizing hospitals, there would need to be more than double the risk of hospitalization given the unmeasured confounder at the high-utilizing hospitals to attenuate the odds ratio for hospitalization to 1. When the prevalence of the unmeasured confounder was increased to >50%, similar results were obtained, suggesting that the unmeasured confounder would need to have a high prevalence to attenuate the results observed in these analyses.

    Discussion

    In this multicenter study of children with CAP, there was significant variation across EDs in the use of diagnostic testing. Certain EDs were consistently high utilizers of diagnostic tests for CAP. High utilization was associated with increased odds of hospitalization. Although it might be expected that hospitals which test less might “miss” cases and thus have a higher ED revisit rate, our results demonstrate that low utilization was not associated with increased revisit rates. This finding suggests that high-utilizing hospitals may be able to decrease utilization and hospitalization without overlooking children who warrant hospital admission.

    Substantial variation in ED use of diagnostic testing was present despite adjustment for patient characteristics. These results build on those of previous studies demonstrating significant variation in testing and antibiotic use among hospitalized children with CAP10 and variation in chest radiograph and antibiotic use in the ED.17,18 In general, the degree of variation in a care process is associated with the level of uncertainty surrounding patient outcomes.28 The first US guidelines for the management of pediatric CAP were released in 2011.6 Although the lack of these guidelines at the time of our study may explain some of the variability we observed, these guidelines also illustrate the ambiguity surrounding diagnostic testing for pediatric pneumonia. Of the 27 recommendations regarding diagnostic testing, almost one-half (including the use of the CBC) are based on low-quality evidence.6 The degree of elevation of the white blood cell count does not reliably predict bacterial etiology or development of a severe course.7,29,30 Despite the paucity of evidence on the utility of CBC in CAP, it was the most frequently ordered laboratory test in our study, and there was substantial variation in its utilization.

    Certain institutions are consistently high utilizers of diagnostic tests. Certain tests, such as coagulation studies, ultrasound, and CT scans, would likely only be ordered in sick patients or in patients with a specific indication. Utilization ranks for these tests seem random and do not correlate with overall hospital utilization. The reverse is observed in tests in which the results do not usually affect clinical outcome in routine CAP, such as CBC, blood cultures, chemistries, and inflammatory markers. For these tests, utilization is highly clustered and strongly correlated with overall hospital utilization. These same tests individually were associated with increased odds of ED revisit across hospitals, whereas the overall measure of utilization (eg, high-utilizing versus low-utilizing hospitals) was not associated with ED revisit. This increase in odds of hospitalization and revisit for these individual tests that are frequently ordered together, without a difference in ED revisit based on overall utilization, suggests that patients with a more severe presentation (at all hospitals) receive these tests and are therefore more likely to return to the ED.

    Test results may be driving disposition decisions in high-utilizing hospitals. There is precedent for results of ED testing to influence the decision to hospitalize.15 ED discharge is less likely if the physician is faced with abnormal test results.31 Although it is possible that low-utilizing hospitals might overlook children who warrant hospitalization as a result of less frequent testing, our results demonstrate no association between test utilization and ED revisit rates. Taken together, these findings suggest that low-utilizing hospitals are not discharging patients from the ED who actually warrant admission at initial presentation.

    The current study used administrative data and thus has several limitations. First, tests and outcomes may be miscoded, resulting in misclassification bias. If present, miscoding would likely be random and nondifferential, resulting in bias toward the null. This limitation is curtailed by use of a validated algorithm as well as through coding consensus conferences held by the CHA that would minimize, although not completely eliminate, this issue. Second, because PHIS comprises freestanding children’s hospitals, our results may not be generalizable to all hospitals caring for children with CAP. No study has examined variation in testing and treatment of pediatric pneumonia at nonchildren’s hospitals; however, there has been documentation of variation in antibiotic prescribing in the office/outpatient setting.5 Given these data and what we know about variation of care, we would have no reason to suspect that the extent of variation would be any less at nonchildren’s hospitals. Third, PHIS does not include information on indications for tests or threshold for admission across hospitals. We attempted to account for this lack of data by excluding patients with complex chronic conditions who may have other indications for testing. In addition, if there were differences in test indications or admission thresholds, these would likely become significant after adjusting for case mix, which we accomplished by using mixed-effects regression models, thus minimizing the influence of these factors in our analyses. Furthermore, limiting testing to performance on the day of the visit may minimize the true rate of diagnostic testing, particularly for hospitals that have a high patient burden in the evening and overnight hours. To account for this limitation, we repeated analyses for each diagnostic test, including testing on both hospital days 1 and 2 without substantial differences in our results. Fourth, we do not have test results, and it is therefore impossible to know precisely the effect of the result of a test on the disposition decision. However, the variation and association of utilization with disposition were significant after controlling for patient-level and hospital-level covariates in a statistical model that accounted for clustering within hospitals.

    Finally, the PHIS database does not include a robust measure of illness severity or initial presenting symptoms. It is possible that individual patient severity may confound the relationship between utilization and disposition. Furthermore, spectrum bias may be present if certain hospitals care for more severe patients overall. We addressed these limitations in several ways. We included as a covariate in the regression models each hospital’s average overall APR-DRG severity score as a proxy for overall severity level at the hospital level. To further explore the relationship between severity and utilization, we performed additional analyses that found no association between overall hospital APR-DRG severity score and utilization tertile. In addition, the narrow range of overall APR-DRG scores across hospitals indicates minimal differences in overall severity of illness. The lack of a difference in short-stay hospitalizations suggests that high-utilizing hospitals are not seeing more severe patients overall. Finally, in exploring the effects of an unknown confounder on our results, we found that such a confounder (eg, severity) would have to be highly prevalent to attenuate the results.

    Conclusions

    The significant across-hospital variation in diagnostic tests performed in the ED for childhood CAP illustrates the need to improve the quality of care provided. If overutilization can be diminished, there is the potential to decrease unnecessary hospitalizations, decrease costs, prevent unnecessary hospital-acquired infections, and potentially improve short-term quality of life in children with CAP. The results of this study argue for a national quality improvement effort to better understand utilization of resources in this common pediatric disease. Future research should seek to better understand motivation for testing in CAP and to prospectively evaluate the effects of testing on disposition decision-making and clinical outcomes.

    Footnotes

      • Accepted May 17, 2013.
    • Address correspondence to Todd A. Florin, MD, MSCE, Division of Emergency Medicine, Cincinnati Children’s Hospital Medical Center, 3333 Burnet Ave, ML 2008, Cincinnati, OH 45229. E-mail: todd.florin{at}cchmc.org
    • Dr Florin conceptualized and designed the study, analyzed and interpreted the data, drafted the initial manuscript, and approved the final manuscript as submitted; Dr French was involved in the design of the study, supervised the data analysis and interpretation, reviewed and revised the manuscript, and approved the final manuscript as drafted; Drs Zorc and Alpern were involved in the design of the study, participated in the interpretation of the data, reviewed and revised the manuscript, and approved the final manuscript as drafted; and Dr Shah supervised the conceptualization and design of the study, participated in the interpretation of the data, reviewed and revised the manuscript, and approved the final manuscript as drafted.

    • FINANCIAL DISCLOSURE: The authors have indicated they have no financial relationships relevant to this article to disclose.

    • FUNDING: Supported by a pilot grant from The Center for Pediatric Clinical Effectiveness at The Children’s Hospital of Philadelphia.

    • COMPANION PAPERS: Companions to this article can be found on pages 229, 245, and 369, and online at www.pediatrics.org/cgi/doi/10.1542/peds.2013-0359, www.pediatrics.org/cgi/doi/10.1542/peds.2012-2830, and www.pediatrics.org/cgi/doi/10.1542/peds.2013-1569.

    References

    1. ↵
      1. Grijalva CG,
      2. Nuorti JP,
      3. Arbogast PG,
      4. Martin SW,
      5. Edwards KM,
      6. Griffin MR
      . Decline in pneumonia admissions after routine childhood immunisation with pneumococcal conjugate vaccine in the USA: a time-series analysis. Lancet. 2007;369(9568):1179–1186pmid:17416262
      OpenUrlCrossRefPubMed
      1. Peck AJ,
      2. Holman RC,
      3. Curns AT,
      4. et al
      . Lower respiratory tract infections among American Indian and Alaska Native children and the general population of U.S. Children. Pediatr Infect Dis J. 2005;24(4):342–351pmid:15818295
      OpenUrlCrossRefPubMed
      1. Lee GE,
      2. Lorch SA,
      3. Sheffler-Collins S,
      4. Kronman MP,
      5. Shah SS
      . National hospitalization trends for pediatric pneumonia and associated complications. Pediatrics. 2010;126(2):204–213pmid:20643717
      OpenUrlAbstract/FREE Full Text
      1. Zhou F,
      2. Kyaw MH,
      3. Shefer A,
      4. Winston CA,
      5. Nuorti JP
      . Health care utilization for pneumonia in young children after routine pneumococcal conjugate vaccine use in the United States. Arch Pediatr Adolesc Med. 2007;161(12):1162–1168pmid:18056561
      OpenUrlCrossRefPubMed
    2. ↵
      1. Kronman MP,
      2. Hersh AL,
      3. Feng R,
      4. Huang YS,
      5. Lee GE,
      6. Shah SS
      . Ambulatory visit rates and antibiotic prescribing for children with pneumonia, 1994-2007. Pediatrics. 2011;127(3):411–418pmid:21321038
      OpenUrlAbstract/FREE Full Text
    3. ↵
      Bradley JS, Byington CL, Shah SS, et al; Pediatric Infectious Diseases Society and the Infectious Diseases Society of America. The management of community-acquired pneumonia in infants and children older than 3 months of age: clinical practice guidelines by the Pediatric Infectious Diseases Society and the Infectious Diseases Society of America. Clin Infect Dis. 2011;53(7):e25–e76
    4. ↵
      1. Korppi M,
      2. Heiskanen-Kosma T,
      3. Leinonen M
      . White blood cells, C-reactive protein and erythrocyte sedimentation rate in pneumococcal pneumonia in children. Eur Respir J. 1997;10(5):1125–1129pmid:9163657
      OpenUrlAbstract
    5. ↵
      1. Nohynek H,
      2. Valkeila E,
      3. Leinonen M,
      4. Eskola J
      . Erythrocyte sedimentation rate, white blood cell count and serum C-reactive protein in assessing etiologic diagnosis of acute lower respiratory infections in children. Pediatr Infect Dis J. 1995;14(6):484–490pmid:7667052
      OpenUrlCrossRefPubMed
    6. ↵
      1. Gorton CP,
      2. Jones JL
      . Wide geographic variation between Pennsylvania counties in the population rates of hospital admissions for pneumonia among children with and without comorbid chronic conditions. Pediatrics. 2006;117(2):176–180pmid:16452342
      OpenUrlAbstract/FREE Full Text
    7. ↵
      1. Brogan TV,
      2. Hall M,
      3. Williams DJ,
      4. et al
      . Variability in processes of care and outcomes among children hospitalized with community-acquired pneumonia. Pediatr Infect Dis J. 2012;31(10):1036–1041pmid:22653486
      OpenUrlPubMed
    8. ↵
      1. Goodman DC
      . Unwarranted variation in pediatric medical care. Pediatr Clin North Am. 2009;56(4):745–755pmid:19660625
      OpenUrlCrossRefPubMed
    9. ↵
      1. Gilbert K,
      2. Gleason PP,
      3. Singer DE,
      4. et al
      . Variations in antimicrobial use and cost in more than 2,000 patients with community-acquired pneumonia. Am J Med. 1998;104(1):17–27pmid:9528715
      OpenUrlCrossRefPubMed
      1. McCormick D,
      2. Fine MJ,
      3. Coley CM,
      4. et al
      . Variation in length of hospital stay in patients with community-acquired pneumonia: are shorter stays associated with worse medical outcomes? Am J Med. 1999;107(1):5–12pmid:10403346
      OpenUrlCrossRefPubMed
    10. ↵
      1. Fine MJ,
      2. Stone RA,
      3. Singer DE,
      4. et al
      . Processes and outcomes of care for patients with community-acquired pneumonia: results from the Pneumonia Patient Outcomes Research Team (PORT) cohort study. Arch Intern Med. 1999;159(9):970–980pmid:10326939
      OpenUrlCrossRefPubMed
    11. ↵
      1. Baker MD,
      2. Bell LM,
      3. Avner JR
      . Outpatient management without antibiotics of fever in selected infants. N Engl J Med. 1993;329(20):1437–1441pmid:8413453
      OpenUrlCrossRefPubMed
    12. ↵
      1. Goble MM,
      2. Benitez C,
      3. Baumgardner M,
      4. Fenske K
      . ED management of pediatric syncope: searching for a rationale. Am J Emerg Med. 2008;26(1):66–70pmid:18082784
      OpenUrlCrossRefPubMed
    13. ↵
      1. Neuman MI,
      2. Graham D,
      3. Bachur R
      . Variation in the use of chest radiography for pneumonia in pediatric emergency departments. Pediatr Emerg Care. 2011;27(7):606–610pmid:21712748
      OpenUrlCrossRefPubMed
    14. ↵
      1. Alak A,
      2. Seabrook JA,
      3. Rieder MJ
      . Variations in the management of pneumonia in pediatric emergency departments: compliance with the guidelines. CJEM. 2010;12(6):514–519pmid:21073778
      OpenUrlPubMed
    15. ↵
      1. Fletcher DM
      . Achieving data quality. How data from a pediatric health information system earns the trust of its users. J AHIMA. 2004;75(10):22–26pmid:15559835
      OpenUrlPubMed
    16. ↵
      1. Whittle J,
      2. Fine MJ,
      3. Joyce DZ,
      4. et al
      . Community-acquired pneumonia: can it be defined with claims data? Am J Med Qual. 1997;12(4):187–193pmid:9385729
      OpenUrlAbstract/FREE Full Text
    17. ↵
      Williams DH, Myers A, Queen M, et al. Accuracy of ICD-9 codes to identify community-acquired pneumonia hospitalizations. Paper presented at: Pediatric Academic Societies Meeting; April 28, 2012; Boston, MA. Publication 1135.7.
    18. ↵
      1. Feudtner C,
      2. Hays RM,
      3. Haynes G,
      4. Geyer JR,
      5. Neff JM,
      6. Koepsell TD
      . Deaths attributed to pediatric complex chronic conditions: national trends and implications for supportive care services. Pediatrics. 2001;107(6). Available at: www.pediatrics.org/cgi/content/full/107/6/e99pmid:11389297
      OpenUrlCrossRefPubMed
    19. ↵
      1. Feudtner C,
      2. Levin JE,
      3. Srivastava R,
      4. et al
      . How well can hospital readmission be predicted in a cohort of hospitalized children? A retrospective, multicenter study. Pediatrics. 2009;123(1):286–293pmid:19117894
      OpenUrlAbstract/FREE Full Text
    20. ↵
      1. Normand SL,
      2. Shahain DM
      . Statistical and clinical aspects of hospital outcomes profiling. Stat Sci. 2007;22(2):206–226
      OpenUrlCrossRef
    21. ↵
      1. Jones HE,
      2. Spiegelhalter DJ
      . The identification of “unusual” health-care providers from a hierarchical model. Am Stat. 2011;65(3):154–163
      OpenUrlCrossRef
    22. ↵
      1. Berlin JA,
      2. Kimmel SE,
      3. Ten Have TR,
      4. Sammel MD
      . An empirical comparison of several clustered data approaches under confounding due to cluster effects in the analysis of complications of coronary angioplasty. Biometrics. 1999;55(2):470–476pmid:11318202
      OpenUrlCrossRefPubMed
    23. ↵
      1. Lin DY,
      2. Psaty BM,
      3. Kronmal RA
      . Assessing the sensitivity of regression results to unmeasured confounders in observational studies. Biometrics. 1998;54(3):948–963pmid:9750244
      OpenUrlCrossRefPubMed
    24. ↵
      1. McPherson K,
      2. Wennberg JE,
      3. Hovind OB,
      4. Clifford P
      . Small-area variations in the use of common surgical procedures: an international comparison of New England, England, and Norway. N Engl J Med. 1982;307(21):1310–1314pmid:7133068
      OpenUrlCrossRefPubMed
    25. ↵
      1. Christ-Crain M,
      2. Müller B
      . Procalcitonin and pneumonia: is it a useful marker? Curr Infect Dis Rep. 2007;9(3):233–240pmid:17430706
      OpenUrlCrossRefPubMed
    26. ↵
      1. Jensen JU,
      2. Heslet L,
      3. Jensen TH,
      4. Espersen K,
      5. Steffensen P,
      6. Tvede M
      . Procalcitonin increase in early identification of critically ill patients at high risk of mortality. Crit Care Med. 2006;34(10):2596–2602pmid:16915118
      OpenUrlCrossRefPubMed
    27. ↵
      1. Mold JW,
      2. Stein HF
      . The cascade effect in the clinical care of patients. N Engl J Med. 1986;314(8):512–514pmid:3945278
      OpenUrlCrossRefPubMed
    • Copyright © 2013 by the American Academy of Pediatrics
    PreviousNext
    Back to top

    Advertising Disclaimer »

    In this issue

    Pediatrics
    Vol. 132, Issue 2
    1 Aug 2013
    • Table of Contents
    • Index by author
    View this article with LENS
    PreviousNext
    Email Article

    Thank you for your interest in spreading the word on American Academy of Pediatrics.

    NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

    Enter multiple addresses on separate lines or separate them with commas.
    Variation in Emergency Department Diagnostic Testing and Disposition Outcomes in Pneumonia
    (Your Name) has sent you a message from American Academy of Pediatrics
    (Your Name) thought you would like to see the American Academy of Pediatrics web site.
    CAPTCHA
    This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
    Request Permissions
    Article Alerts
    Log in
    You will be redirected to aap.org to login or to create your account.
    Or Sign In to Email Alerts with your Email Address
    Citation Tools
    Variation in Emergency Department Diagnostic Testing and Disposition Outcomes in Pneumonia
    Todd A. Florin, Benjamin French, Joseph J. Zorc, Elizabeth R. Alpern, Samir S. Shah
    Pediatrics Aug 2013, 132 (2) 237-244; DOI: 10.1542/peds.2013-0179

    Citation Manager Formats

    • BibTeX
    • Bookends
    • EasyBib
    • EndNote (tagged)
    • EndNote 8 (xml)
    • Medlars
    • Mendeley
    • Papers
    • RefWorks Tagged
    • Ref Manager
    • RIS
    • Zotero
    Share
    Variation in Emergency Department Diagnostic Testing and Disposition Outcomes in Pneumonia
    Todd A. Florin, Benjamin French, Joseph J. Zorc, Elizabeth R. Alpern, Samir S. Shah
    Pediatrics Aug 2013, 132 (2) 237-244; DOI: 10.1542/peds.2013-0179
    del.icio.us logo Digg logo Reddit logo Twitter logo CiteULike logo Facebook logo Google logo Mendeley logo
    Print
    Download PDF
    Insight Alerts
    • Table of Contents

    Jump to section

    • Article
      • Abstract
      • Methods
      • Results
      • Discussion
      • Conclusions
      • Footnotes
      • References
    • Figures & Data
    • Supplemental
    • Info & Metrics
    • Comments

    Related Articles

    • PubMed
    • Google Scholar

    Cited By...

    • Variation in Care and Clinical Outcomes Among Infants Hospitalized With Hyperbilirubinemia
    • Variation in Early Inflammatory Marker Testing for Infection-Related Hospitalizations in Children
    • Management of children visiting the emergency department during out-of-office hours: an observational study
    • Inpatient Observation After Transition From Intravenous to Oral Antibiotics
    • Biomarkers and Disease Severity in Children With Community-Acquired Pneumonia
    • Trends in Chest Radiographs for Pneumonia in Emergency Departments
    • Patterns of Electrolyte Testing at Childrens Hospitals for Common Inpatient Diagnoses
    • Facilitators of interdepartmental quality improvement: a mixed-methods analysis of a collaborative to improve pediatric community-acquired pneumonia management
    • Clinical Risk Factors for Revisits for Children With Community-Acquired Pneumonia
    • Guideline Adoption for Community-Acquired Pneumonia in the Outpatient Setting
    • Variation in Care and Clinical Outcomes in Children Hospitalized With Orbital Cellulitis
    • Variation in Pediatric Procedural Sedations Across Childrens Hospital Emergency Departments
    • Reliability of Examination Findings in Suspected Community-Acquired Pneumonia
    • Empiric Antibiotic Use and Susceptibility in Infants With Bacterial Infections: A Multicenter Retrospective Cohort Study
    • Hospital-Level Variation in Practice Patterns and Patient Outcomes for Pediatric Patients Hospitalized With Functional Constipation
    • Variation in Inpatient Croup Management and Outcomes
    • A Multicenter Collaborative to Improve Care of Community Acquired Pneumonia in Hospitalized Children
    • Use of Low-Value Pediatric Services Among the Commercially Insured
    • Variation in Diagnostic Testing and Hospitalization Rates in Children With Acute Gastroenteritis
    • Point-of-care lung ultrasound in young children with respiratory tract infections and wheeze
    • Tools for 'safety netting in common paediatric illnesses: a systematic review in emergency care
    • The Family Perspective on Hospital to Home Transitions: A Qualitative Study
    • Impact of Physician Scorecards on Emergency Department Resource Use, Quality, and Efficiency
    • Blood Culture in Evaluation of Pediatric Community-Acquired Pneumonia: A Systematic Review and Meta-analysis
    • Variation in the Use of Procedural Sedation for Incision and Drainage of Skin and Soft Tissue Infection in Pediatric Emergency Departments
    • Antibiotic and Diagnostic Discordance Between ED Physicians and Hospitalists for Pediatric Respiratory Illness
    • Variation in Care of the Febrile Young Infant <90 Days in US Pediatric Emergency Departments
    • Variation in Emergency Department Admission Rates in US Children's Hospitals
    • Establishing Benchmarks for the Hospitalized Care of Children With Asthma, Bronchiolitis, and Pneumonia
    • Common and Costly Hospitalizations for Pediatric Mental Health Disorders
    • Old foe, old remedy * Studies support use of older, inexpensive antibiotics for community acquired pneumonia
    • The Power of a Laboratory--Are We Taking Full Ownership as Hospitalists?
    • Google Scholar

    More in this TOC Section

    • Neonatal SARS-CoV-2 Infections in Breastfeeding Mothers
    • Racial and Ethnic Diversity in Studies Funded Under the Best Pharmaceuticals for Children Act
    • Clinical Impact of a Diagnostic Gastrointestinal Panel in Children
    Show more Article

    Similar Articles

    Subjects

    • Infectious Disease
      • Infectious Disease
    • Emergency Medicine
      • Emergency Medicine

    Keywords

    • children
    • clinical practice variation
    • diagnostic tests
    • emergency medicine
    • health resources
    • health services research
    • hospitalization
    • logistic models
    • physician practice patterns
    • pneumonia
    • radiography
    • utilization
    • Journal Info
    • Editorial Board
    • Editorial Policies
    • Overview
    • Licensing Information
    • Authors/Reviewers
    • Author Guidelines
    • Submit My Manuscript
    • Open Access
    • Reviewer Guidelines
    • Librarians
    • Institutional Subscriptions
    • Usage Stats
    • Support
    • Contact Us
    • Subscribe
    • Resources
    • Media Kit
    • About
    • International Access
    • Terms of Use
    • Privacy Statement
    • FAQ
    • AAP.org
    • shopAAP
    • Follow American Academy of Pediatrics on Instagram
    • Visit American Academy of Pediatrics on Facebook
    • Follow American Academy of Pediatrics on Twitter
    • Follow American Academy of Pediatrics on Youtube
    • RSS
    American Academy of Pediatrics

    © 2021 American Academy of Pediatrics