ELECTRONIC ARTICLE |
,
,
,¶
* Department of Pediatrics, Childrens Hospital of Western Ontario, London, Ontario, Canada
Departments of Epidemiology
Biostatistics, Montreal Childrens Hospital, McGill University, Montreal, Quebec, Canada
|| Department of Pediatrics, Ste-Justine Hospital, University of Montreal, Montreal, Quebec, Canada
¶ Departments of Pediatrics
# Radiology, Montreal Childrens Hospital, McGill University, Montreal, Quebec, Canada
| ABSTRACT |
|---|
|
|
|---|
Methods. Children (116 years) with clinically suspected pneumonia were studied prospectively. The presenting features were compared between the children with and without focal infiltrates using
2 analysis, t test, and odds ratio with 95% confidence intervals. A multivariate prediction rule was developed using logistic regression.
Results. A total of 570 were studied. Risk factors (odds ratio; 95% confidence interval) for the presence of focal infiltrates included history of fever (3.1; 1.75.3), decreased breath sounds (1.4; 1.02.0), crackles (2.0; 1.42.9), retractions (2.8; 1.07.6), grunting (7.3; 1.148.1), fever (1.5; 1.21.9), tachypnea (1.8; 1.32.5), and tachycardia (1.3; 1.01.6). We then used logistic regression to develop a candidate prediction rule for the variables of fever, decreased breath sounds, crackles, and tachypnea, which had an area under the receiver operating curve of 0.668. This rule had excellent sensitivity (93.1%98%) yet poor specificity (5.7%19.4%).
Conclusions. Multiple predictive factors for children with suspected pneumonia have been identified. Patients with focal infiltrates were more likely in our study to have a history of fever, tachypnea, increased heart rate, retractions, grunting, crackles, or decreased breath sounds. A multivariate prediction rule shows promise for the accurate prediction of pneumonia in children. However, the prospective evaluation of this multivariate prediction rule in a clinical setting is still required.
Key Words: pneumonia chest radiographs children predictive factors
Abbreviations: ED, emergency department OR, odds ratio CI, confidence interval
The accurate diagnosis of pneumonia in children remains an important yet difficult clinical problem. The chest radiograph remains the diagnostic test of choice in tertiary care centers. Given that the decision to pursue a diagnostic chest radiograph in the context of suspected pneumonia is largely influenced by clinical predictors of pediatric pneumonia, it is important to have these determined accurately.
The clinical findings of patients with radiographic pneumonia have been described previously in both adult and pediatric populations in developed countries.16 Some studies limit themselves to very young children.79 However, the number of pediatric patients studied with radiographic pneumonia has been small.15
In 1997, an evidence-based review of the literature dealing with pediatric pneumonia was published by a group of pediatric infectious disease specialists and a microbiologist.10 The authors concluded that the absence of the pulmonary cluster as defined by Leventhal1 of respiratory distress, tachypnea, rales, and decreased breath sounds accurately excluded pneumonia. This specific recommendation was based on a study that described the clinical predictors assessed by pediatric residents of only 26 patients with pneumonia during a 6-month period.1
In a recent publication, these evidence-based guidelines were assessed.4 The authors applied these guidelines to 67 children who were 5 years or younger and had radiographic pneumonia and determined that they were insufficiently sensitive for clinical decision-making4 (45% sensitive, 66% specific, 25% positive predictive value, 82% negative predictive value). The same group of authors attempted to establish a clinical prediction rule.5 In 80 children who were younger than 16 years, they concluded that the presence of any 4 of temperature
38°C, oxygen saturation <95%, positive human immunodeficiency virus status, or cough productive of colored sputum was 93% sensitive for identifying radiographic pneumonia.5 This prediction rule is problematic in that most children do not expectorate effectively until mid-childhood, and ambulatory pneumonia is a profound problem in immunocompetent children. Furthermore, this rule is limited in its application in centers with a low incidence of human immunodeficiency virus positivity.
The primary objective of our study was to determine which clinical factors accurately predict the presence of focal infiltrates in children 1 to 16 years of age with clinically suspected pneumonia in a pediatric emergency department (ED). Secondary objective were to determine the accuracy of the evidence-based guidelines previously discussed and to develop a predictive rule for the presence of infiltrates.
| METHODS |
|---|
|
|
|---|
Patients who were younger than 1 year were excluded because of the higher likelihood of bronchiolitis being diagnosed and the resultant variation of chest radiograph interpretation. Patients who were older than 16 years were excluded as they are more comparable to adult patients. Also, patients were excluded when they had chronic respiratory disease (eg, cystic fibrosis, bronchopulmonary dysplasia), chronic congenital or complex cardiac disease, gastroesophageal reflux disease, sickle cell anemia, malignancy, or spastic quadriplegia. Children with asthma were excluded when they were having an acute exacerbation, eg, requiring >1 bronchodilator treatment or systemic steroids in the ED. Patients were also excluded when they had a recent history of pneumonia confirmed by radiography in the previous 8 weeks or when they had taken antibiotics within the previous 2 weeks. As well, patients were excluded when they were critically ill, because only the portable frontal view is typically performed.
The patients were recruited by 11 designated full-time attending board-eligible/board-certified pediatric emergency physicians. Once inclusion and exclusion criteria were confirmed and informed consent was obtained by the recruiting physician, patients had frontal and lateral chest radiographs taken.
The gold standard was taken as consensus of 2 of 3 pediatric radiologists. Radiology review consisted of 1 of 7 radiologists who reported the films in real time and 1 designated, blinded study radiologist who reviewed all study films. When the initial 2 readings were discordant, a third reading was done by a second designated, blinded study radiologist. The radiologists were asked to classify the radiographs as positive when pulmonary opacities were present and negative when they were absent. The interobserver reliability among the radiologists was tested a priori. The weighted
level of agreement (±1 standard deviation) was 0.57 ± 0.17 among the 7 radiologists.
Outcome Measures
The primary outcome variable was the difference in the presenting clinical symptoms and signs between children with and without focal pulmonary infiltrates. A secondary outcome variable was to determine the accuracy of the previously recommended evidence-based guidelines. A candidate prediction rule for the presence of infiltrates was also developed.
Data Collection
The charts of all patients who had suspected pneumonia and had a chest radiograph performed during the study period were reviewed. Baseline demographic variables such as age and gender were collected in a prospective manner by the completion of a study questionnaire at the time of recruitment. Physicians completed the questionnaire indicating vital signs (temperature, respiratory rate, heart rate, and oxygen saturation), history (asthma), respiratory symptoms (cough, shortness of breath, pleuritic chest pain, coryza, wheeze), general symptoms (chills, irritability, poor feeding), and respiratory signs (retractions, tracheal tug, nasal flaring, grunting, crackles, bronchial sounds, wheezes, dullness to percussion, decreased breath sounds). Because the age of some patients limited exact symptom definitions, difficulty breathing was used interchangeably with shortness of breath, and pleuritic chest pain was inclusive of any chest discomfort with breathing. Physicians checked questionnaire boxes indicating the presence of each study symptom and sign. The physicians were expected to complete the questionnaire during the ED evaluation. All ED charts were reviewed during the study period to ascertain the number of patients missed and excluded and the reasons.
Sample Size
The sample size for the multivariate analysis was calculated on the general requirement for 10 observations per predictor variable. We estimated that 200 patients with positive radiographs would be required because we planned to enter 20 variables in the analysis.
Statistical Analysis
Data were analyzed with SPSS and S-Plus. Continuous data were analyzed with the t test statistic, and categoric data were analyzed with the
2 statistic. P < .05 was considered statistically significant. The odds ratio (OR) with 95% confidence intervals (CIs) was calculated. As well, the sensitivity, specificity, and positive and negative predictive values of each clinical variable were calculated. Finally, we used logistic regression to develop a multivariate prediction rule. The regression analysis was backward stepwise on the basis of statistical significance of the likelihood ratio test and predictive ability of the whole model. The model significance was P < .001.
| RESULTS |
|---|
|
|
|---|
None of the predictive baseline characteristics (age, gender, or asthma history) was statistically significant with respect to the presence of focal infiltrates on chest radiographs. In addition, the baseline and clinical characteristics of the 33 missed patients were similar to the included patients.
The clinical symptoms and signs were also compared. As demonstrated in Table 1, there was a significant difference between the 2 groups for the variable of fever history (previous 24 hours). Similarly, 4 clinical signs were found to be statistically significant: decreased breath sounds, crackles, retractions, and grunting. The sensitivity and specificity of the 5 statistically significant variables were determined (Table 2). The symptom with the greatest sensitivity for pneumonia was history of fever at 92%.
|
|
|
|
We then used logistic regression using all of the studied variables with the presence of focal infiltrates as the outcome to develop a candidate prediction rule. After model reduction, our rule included presence of fever, decreased breath sounds, crackles, and tachypnea. The logistic regression equation is presented in Table 5. This rule had an area under the receiver operating curve of 0.668, which suggests a relatively effective rule. Table 6 presents the sensitivity and specificity of several combinations of predictors used in the logistic regression equation.
|
|
| DISCUSSION |
|---|
|
|
|---|
Similar to the findings of Rothrock et al,4 the evidence-based guidelines were found to be insensitive (80.9%). This limits their usefulness to clinicians who would rather have a very sensitive tool to eliminate the need to perform a chest radiograph.
A predictive algorithm developed using logistic regression has several advantages. Different decisions can be made depending on combinations of symptoms. We also considered tree-based algorithms. These algorithms provided similar results.
Strong points of this study are that it was the first to evaluate prospectively the clinical findings in >200 children with radiographic-proven pneumonia. Other strengths are that the patients were studied over a 19-month period, which minimized seasonal variation. Consensus agreement of chest radiograph interpretation by the radiologists involved in the study limited the error associated with the reliance on 1 single radiologist as done in previous studies. This study focused on the use of predictive variables about which information is readily available to physicians when patients present. In an outpatient setting, it is often cumbersome to order a chest radiograph, so the need for clinical prediction is paramount.
Limitations of the study are that only full-time ED physicians were selected as participating attending physicians and that the study was conducted at a tertiary care center. Given that the overall prevalence of the radiographic diagnosis of pneumonia was 36%, the positive predictive accuracy would likely be reduced in an office setting as a result of the presence of less sick patients. Similarly, the positive and negative predictive accuracy would be affected by the different selection criteria that different physicians use when ordering a chest radiograph.
Unfortunately, the oxygen saturation for each patient was not systematically recorded. Therefore, no analysis could be performed accurately on that variable. Furthermore, we did not adjust the initial vital signs according to the patients temperature. No attempts were made to differentiate bacterial from viral causes of the patients pneumonia.
This study shows the difficulties inherent in the development of a prediction rule for the presence of pneumonia. Table 6 clearly outlines this difficulty contrasting the combination variables high sensitivity with their low specificity. Symptoms that are sensitive, such as fever, are not specific because they are present in many patients without pneumonia. Symptoms that are specific, such as the presence of crackles, are not sensitive because they are apparent only in a selected group of patients. Therefore, it seems that a highly specific prediction rule is difficult to achieve. Weighing the balance between additional radiography versus missing a case of pneumonia is also a strong consideration in this regard.
In the context of pneumonia, physicians at our institution use chest radiography to confirm their clinical suspicion or to rule out pneumonia when they are unsure of their clinical finding. The application of our clinical prediction rule would potentially be applicable to the former scenario. According to Table 6, it can be seen that the combination of fever and any 1 of decreased breath sounds, crackles, or tachypnea yielded a sensitivity that ranged from 93.1% to 96.1%. One may still consider radiography in this clinical picture. Similarly, the presence of fever plus all 3 of the other variables increased the sensitivity to 98%. In this setting, one may postulate that chest radiography is not required given the high likelihood of a positive radiograph. This may be more applicable to an ambulatory care setting given that patient expectations for chest radiography in an ED may be higher.
The World Health Organization does not recommend chest radiography in the management of acute lower respiratory tract infections in children in developing countries.11 A study from South Africa12 randomized patients who met the World Health Organization case definition of pneumonia11 into 1 group that underwent chest radiography and another group that did not. The presence or absence of chest radiography was not shown to affect clinical outcome in this study. Therefore, the consideration for the elimination of chest radiography in selected patients and specific settings as previously discussed is not unreasonable.
Following the guidelines for development of prediction rules suggested by Laupacis et al,13 this rule should be validated on new data from a similar setting. Once this has been accomplished, clinical practice may then change.
| CONCLUSION |
|---|
|
|
|---|
| ACKNOWLEDGMENTS |
|---|
Results of this study were presented in part at the American Academy of Pediatrics Annual General Meeting in Chicago, IL; October 2000.
| FOOTNOTES |
|---|
Reprint requests to (T.L.) Childrens Hospital of Western Ontario, 800 Commissioners Rd E, London, Ontario, Canada, N6C 2V5. E-mail: tim.lynch{at}lhsc.on.ca
| REFERENCES |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
J. Roukema, E. W. Steyerberg, J. van der Lei, and H. A. Moll Randomized Trial of a Clinical Decision Support System: Impact on the Management of Children with Fever without Apparent Source J. Am. Med. Inform. Assoc., January 1, 2008; 15(1): 107 - 113. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. E Clark, D. Hammal, D. Spencer, and F. Hampton Children with pneumonia: how do they present and how are they managed? Arch. Dis. Child., May 1, 2007; 92(5): 394 - 398. [Abstract] [Full Text] [PDF] |
||||
Read all P3Rs
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||