a Department of Emergency Medicine, College of Medicine, University of California, Irvine, California
b Division of Emergency Medicine, School of Medicine, University of California, Los Angeles, California
c Division of Emergency Medicine, School of Medicine, University of California, Sacramento, California
d Division of Emergency Medicine, State University of New York, Stonybrook, New York
e Departments of Emergency Medicine
f Surgery, Cooper University Hospital, Camden, New Jersey
| ABSTRACT |
|---|
|
|
|---|
METHODS. An analysis was conducted of the pediatric cohort involved in the derivation set of National Emergency X-Radiography Utilization Study II (NEXUS II), a prospective, observational, multicenter study of all patients who had blunt head trauma and underwent cranial computed tomography (CT) imaging at 1 of 21 emergency departments. We determined the test performance characteristics of the 8-variable NEXUS II decision instrument, derived from the entire NEXUS II cohort, in the pediatric cohort (018 years of age), as well as in the very young children (<3 years). Clinically important ICI was defined as ICI that required neurosurgical intervention (craniotomy, intracranial pressure monitoring, or mechanical ventilation) or was likely to be associated with significant long-term neurologic impairment.
RESULTS. NEXUS II enrolled 1666 children, 138 (8.3%) of whom had clinically important ICI. The decision instrument correctly identified 136 of the 138 cases and classified 230 as low risk. A total of 309 children were younger than 3 years, among whom 25 had ICI. The decision instrument identified all 25 cases of clinically important ICI in this subgroup.
CONCLUSIONS. The decision instrument derived in the large NEXUS II cohort performed with similarly high sensitivity among the subgroup of children who were included in this study. Clinically important ICI were rare in children who did not exhibit at least 1 of the NEXUS II risk criteria.
Key Words: blunt injuries head trauma pediatric
Abbreviations: EDemergency department ICIintracranial injury CTcomputed tomography NEXUS IINational Emergency X-Radiography Utilization Study II CIconfidence interval NPVnegative predictive value
Head injury is a common cause of emergency-department (ED) presentation, accounting for
1 million visits annually.1 Although the majority of patients with head trauma have a minor injury that requires no specific therapy, a small number prove to have clinically significant intracranial injury (ICI). Because of the risk of unrecognized ICI, clinicians liberally order cranial computed tomography (CT) in blunt trauma, generating annual charges of nearly $750 million while revealing significant ICI in <60000 patients.24 The overuse of CT may be even more pronounced in children, who comprise almost 40% of these patients,5 because of the greater difficulty in assessing neurologic function in at least some of them.
A number of investigators have attempted to identify clinical criteria that accurately predict which patients are at risk for ICI and thus limit CT imaging to such patients.325 Although these reports provide some preliminary evidence, limitations in study design, including retrospective chart review, small sample size, and restricted age or selection criteria, limit the strength of any of these instruments.711,1315,1825 The National Emergency X-Radiography Utilization Study II (NEXUS II) is an ongoing, prospective, multicenter study of blunt head trauma victims that was designed to derive and subsequently validate a decision aid to identify a group of patients, from among those with head trauma, who are at very low risk for significant ICI, thus enabling a reduction in unwarranted cranial CT imaging.26,27 The derivation set of NEXUS II identified a decision aid, based on both adult and pediatric patients, that was highly sensitive (98.3%; 95% confidence interval [CI]: 97.299.0) for ICI in this cohort, excluded a significant lesion with high negative predictive value (NPV: 99.1%; 95% CI: 98.599.5), and, if prospectively validated, should be able to identify safely a small subset of patients who can be discharged without imaging (13.7%; 95% CI: 13.114.3).27
The next phase of NEXUS II will involve validation of the decision aid. Before beginning enrollment of additional study patients, our objective with this planned subset analysis was to determine if the decision instrument was as sensitive in the pediatric subgroup as it was in the overall derivation set. Because we recognize that the pediatric population is not homogeneous and that neurologic assessment is often more difficult in the very young, we further decided to examine the performance of the instrument in the special subset of very young children who are younger than 3 years.
| METHODS |
|---|
|
|
|---|
Participating hospitals enrolled all blunt head trauma patients who underwent cranial CT imaging. The decision to obtain head CT was made by the ED clinicians on the basis of their own criteria and was not directed in any way by the study. These clinicians collected data on a standardized data form before ordering the CT scan. Information was available to help clinicians define study variables, but they were not required to access such information (Appendix 1). The clinicians recorded whether each of the 19 candidate criteria was present, absent, or unable to be determined (eg, it would be impossible for a comatose patient to report a severe headache; Table 1).
|
|
> 0.50.31 The optimum decision instrument derived for the entire study cohort of 13728 patients is composed of the following 8 variables: evidence of significant skull fracture, altered level of alertness, neurologic deficit, persistent vomiting, presence of scalp hematoma, abnormal behavior, coagulopathy, and age >65 years.26 This instrument had a sensitivity of 98.3% (95% CI: 97.299.0) and a specificity of 13.7% (95% CI: 13.114.3) in all study patients.
This current subset analysis evaluates the test characteristics of the derived decision instrument with regard to all pediatric patients (018 years of age) who were enrolled in the study. Because none of the children met the last criterion of "age >65 years," we modified the decision instrument slightly to include only the other 7 criteria. For the rule to be clinically useful in children, it must retain very high sensitivity (at least 98.5%) and NPV (so as not to miss cases of clinically significant ICI), as well as some reasonable degree of specificity (so as to allow some reduction in CT imaging). We acknowledge that our definition of clinically important ICI means that some patients with abnormalities on CT will not be identified; however, our specific aim is to identify patients who most likely will need an intervention. It is clear that even patients without CT abnormalities are at risk for neurologic sequelae; therefore, we believe the optimal rule that will be acceptable to physicians would be one in which at least 98.5% of patients with clinically important ICI are identified.
We performed a secondary analysis of the decision instrument, in the special population of very young children (<3 years of age), because we believed that assessing behavior and neurologic function, as well as other candidate criteria, might be more difficult in this age group,9,11,12,15,22 and we wanted to determine whether the instrument retained desirable test characteristics in this very young cohort.
The study protocols and methods were reviewed by the federal Office for the Protection from Research Risks, as well as by the institutional review board at each site, and appropriate waivers were granted to each participating institution. Data analysis was performed with Stata 6.0 (Stata Corp, College Station, TX).
| RESULTS |
|---|
|
|
|---|
3 years of age or
15 years of age (Fig 1). Demographics of the sample are presented in Table 3. A total of 205 children with blunt trauma had evidence of traumatic injury on head CT, 67 cases were injuries that do not require therapeutic intervention, and 138 (8.3%) children had findings that met our criteria for clinically important ICI. ICI was slightly more common in patients who were
15 years of age but was otherwise evenly distributed among all age groups (Fig 1).
|
|
|
values) for 2 variables, seizure and abnormal cerebellar function, did not exceed our prespecified level of 0.50 and thus may be of limited utility in developing a reliable instrument.
|
|
Two pediatric cases with ICI were not identified using this decision instrument. One of these cases likely represents an error in assessment (an 8-year-old with slight diastasis of the coronal suture was noted to have a large scalp hematoma on tomographic imaging), whereas the other child (a 7-year-old with a small hemorrhagic contusion in the right occipital-temporal area) did not have any of the rule criteria. Neither of these children required neurosurgical intervention.
Among the 309 children who were younger than 3 years, 55% of whom were male, there were 25 (8.1%) cases of clinically important ICI. At least 1 of the 7 candidate variables of the decision instrument was recorded as present in each of the children with significant ICI. The single most common finding in those with clinically important ICI was altered level of alertness, whereas scalp hematoma was also fairly common (Table 5). Of note, clinicians were unable to assess neurologic function completely in 8 of the 25 injured children, but each of these individuals exhibited at least 1 of the other risk factors (Appendix 2). In this sample the decision instrument identified all 25 cases of clinically important ICI (sensitivity: 100%; 95% CI: 86.3100) and classified 15 cases as low risk (specificity: 5.3%; 95% CI: 3.08.6; NPV: 100%; 95% CI: 78.2100).
| DISCUSSION |
|---|
|
|
|---|
The NEXUS II decision instrument27 performed as well among children, including very young children (<3 years of age) as it did in the entire derivation data set, retaining the requisite high sensitivity (98.6%) and NPVs (99.1%) needed for a useful clinical decision instrument. In addition, the very large number of patients studied (even among the pediatric subgroup) allows us to have substantial confidence regarding the precision of our results. Our findings suggest that significant ICI is extremely unlikely in any child who does not exhibit at least 1 of the following high-risk criteria: (1) evidence of significant skull fracture (diastatic, depressed, open, or basilar); (2) altered level of alertness; (3) neurologic deficit; (4) persistent vomiting; (5) presence of scalp hematoma; (6) abnormal behavior; and (7) coagulopathy. Although the final decision guide is composed of 8 distinct criteria, the instrument actually involves only 5 assessments. Examining for evidence of skull fracture and scalp hematoma is equivalent to determining whether there is evidence of significant trauma to the calvarium, whereas examining for focal neurologic deficits, abnormal level of alertness, and abnormal behavior is equivalent to assessing whether there is any evidence of neurologic impairment. The remaining 3 criteria (persistent vomiting, coagulopathy, and age >65) require separate independent evaluations.
The number of injuries missed by the instrument was 2 in 1666 evaluations. This false-negative rate is of a magnitude slightly greater than the potential lethal malignant transformation rate (1 in 1000) associated with the liberal use of CT scanning.32 Although it of course would be optimal to have an instrument that identifies every such injury, it is clear that this could be accomplished only by performing CT scanning of every child with head trauma. In this context, it is further reassuring that among the very few children with ICI missed by the decision instrument, it is likely that almost none will have a serious adverse outcome as a result of such injury. Neither of the children who were missed by the decision instrument in our derivation cohort had an abnormal neurologic examination or developed delayed clinical deterioration. All of the other patients in our cohort who had a similar injury on CT but in whom there were delayed clinical deterioration were easily identifiable as neurologically abnormal on their initial presentation.
Although the specificity of the NEXUS II instrument is low, it still offers some additional benefit to clinical judgment and seems to be capable of improving use of CT resources and limiting unnecessary imaging and its attendant risks (eg, need for sedation, time away from monitored environment, radiation exposure). The specificity measured in this study likely underestimates the true specificity of the instrument in evaluating all children with blunt head trauma, because of the nature of study enrollment. The study enrolled only children who underwent CT scanning; such children exhibited some characteristic, undoubtedly including those criteria incorporated in the decision instrument, that prompted a clinician to obtain imaging. Children whose finding did not raise the suspicion of ICI were less likely to be imaged. Consequently, the individual criteria are likely to be less prevalent among children who were not imaged, and the true specificity of the instrument among all children with blunt head injury is likely to be higher. It is also important to note that we deliberately focused on developing an instrument with high sensitivity and high NPV. Consequently, patients who are classified as "low risk" by the instrument are very unlikely to have significant injuries. This allows the instrument to reduce overall imaging rates safely. However, the instrument has relatively modest specificity and positive predictive value, and the majority of "nonlow-risk" patients do not actually have ICIs. This raises the possibility that clinical judgment could play a role in deciding whether to image some "nonlow-risk" patients. However, we have not specifically evaluated the safety of this approach and cannot endorse such practice at the current time.
Greenes and Schutzman11 found that 19% of children who were younger than 2 years and had ICI after blunt head injury were asymptomatic. Assessing neurologic function and the potential for ICI can be particularly challenging in very young children who have limited verbal and cognitive skills. Our decision instrument seems to be sensitive for ICI in very young patients, as it correctly identified all patients who were younger than 3 years and had a clinically significant ICI. Clinicians were able to evaluate level of alertness and neurologic function in many of these children and when unable to do so found other criteria suggestive of significant ICI and need for imaging. Nevertheless, these findings require validation in a substantially larger cohort of patients, and until this is completed, clinicians should be cautious in evaluating very young children.
Several limitations should be noted. To be enrolled in this study, a patient had to have had a head CT ordered, which was done at the discretion of the treating physician and not dictated by the protocol. It is possible that most patients with a seemingly benign mechanism of injury and/or a normal examination did not undergo CT and therefore were not included in the study; it of course is possible that some such patients had an ICI that was not identified. However, long-term follow-up interviews were conducted on 1266 patients who had sustained blunt head trauma but did not undergo emergent head CT scanning at the time of their initial ED presentation. CT imaging was ultimately obtained in 27 (2.1%) of these patients, MRI was obtained in 29 (2.3%), and 14 underwent skull radiography. No significant ICI was found among the 70 imaged patients. Among the entire 1266 follow-up cohort, there were no cases of missed ICI, none of the patients underwent subsequent hospitalization or neurosurgical intervention to treat ICI, and there were no deaths as a result of ICI.27 We did not collect data on mechanism of injury and therefore cannot comment on this aspect of the epidemiology in our sample or whether adding specific details about the mechanism of injury could improve the operator characteristics of our rule.
We chose not to provide rigid definitions for each of the candidate criteria but rather provided descriptions of possible markers for the presence of each characteristic. We avoided rigid definitions to allow clinicians to judge these elements as part of their routine clinical assessment. We believe that this strategy improves the external validity of the decision aid. All 7 criteria are basic elements of a history and physical examination and have demonstrated high interrater reliability.31
Although the test characteristics of the decision aid suggest that it could be useful in clinical practice, it is important to note that this is a derivation study only and must be validated in a separate cohort before it can be recommended for widespread adoption. In addition, among the subset of patients who were younger than 3 years, for whom the sample size is small, the CIs for sensitivity and NPV are wide, making additional prospective validation in a larger cohort even more crucial.
The NEXUS II decision aid was derived in a cohort of patients of all ages. Although in this study we have shown that its performance among children was equivalent to that for the entire cohort, it is possible that a separate evaluation based only on the pediatric patients (using the same recursive partitioning methods) would have identified a different "optimal instrument," with better test characteristics among children.
| CONCLUSIONS |
|---|
|
|
|---|
| APPENDIX 1: Physician Instructions, Guidelines, and Medical Definitions |
|---|
|
|
|---|
Eligible Patients
Any victim with blunt head trauma is eligible for inclusion in this study. Every blunt trauma patient who undergoes head CT must be enrolled in the study. It currently is not possible to exclude reliably ICIs in blunt head trauma victims who have any of the following: (1) posttraumatic seizure, (2) loss of consciousness (particularly if longer than 5 minutes), (3) severe or progressive headache, (4) coagulopathy (whether hereditary, drug induced, or acquired), (5) abnormal behavior, (6) abnormal level of alertness, (7) signs of basilar or depressed skull fracture, (8) recurrent or forceful vomiting, (9) evidence of intoxication, (10) motor deficit, (11) gait abnormality, (12) cerebellar abnormality, (13) cranial nerve abnormality, (14) inability to read and write name, (15) scalp hematoma, or (16) 65 years or older. Such patients are at risk for ICIs and should be treated appropriately.
Exclusions
Data forms should be completed on all patients who undergo head CT. Patients who undergo CT for reasons other than blunt trauma may have additional indications for imaging studies. This would include patients' being evaluated for penetrating trauma, infections, cerebrovascular accidents, tumors, or any other atraumatic indications. Data will be collected on these patients even though they will not be entered into the blunt head injury study.
The following terms are defined for purposes of clarity and to ensure consistent data collection. They do not represent recommendations for patient evaluation, and they should be considered subject to interpretation by individual physicians.
| ACKNOWLEDGMENTS |
|---|
We thank Guy Merchant, NEXUS Project coordinator, for outstanding contributions to the project, as well as the house officers and attending physicians at each of the study sites, without whose cooperation and hard work the study would not have been possible.
The following centers and investigators collaborated in this study. Principal investigator: W. Mower; co-Investigators: J. Hoffman and M. Herbert; steering committee: M. Herbert, J. Hoffman, W. Mower, C. Pollack, A. Wolfson, and M. Zucker; site investigators: Boston University, Boston Medical Center (Boston, MA): N. Rathlev and G. Barest; Case Western Reserve University, Metrohealth System (Cleveland, OH): R.K. Cydulka and B. Karaman; Cooper Hospital, University Medical Center (Camden, NJ): C. Terregino, A. Nyce, and S. Ross; Emory University Medical Center (Atlanta, GA): D. Lowery and S. Tigges; Hennepin County Medical Center (Minneapolis, MN): B. Mahoney and J. Hollerman; Louisiana State University Medical Center, Charity Hospital (New Orleans, LA): M. Haydel and E. Blaudeau; Maricopa Medical Center (Phoenix, AZ): C. Pollack and M. Connell; Ohio State University Medical Center (Columbus, OH): D.R. Martin and C. Mueller; Stanford University Medical Center (Stanford, CA): S.V. Mahadevan and G. Arabit; State University of New York (Stonybrook, NY): P. Viccellio and S. Fuchs; University of Calgary, Foothills Hospital (Calgary, Alberta, Canada): G. Lazarenko and C. Fong; University of California, Davis, Medical Center (Sacramento, CA): J. Holmes and R.A. McFall; University of California (Irvine, CA): J. Krawczyk; University of California, Center for the Health Sciences (Los Angeles, CA): J. Hoffman and M. Zucker; University of California San Diego Medical Center Hillcrest (San Diego, CA): D. Guss and D. Meltzer; University of California, San Francisco at Fresno, University Medical Center (Fresno, CA): G. Hendey and R. Lesperance; University of Cincinnati, University Hospital (Cincinnati, OH): G.J. Fermann and H.H. Hawkins; University of Missouri, Kansas City, Truman Medical Center (Kansas City, MO): E. Westdorp and S. Go; University of Pennsylvania Medical Center (Philadelphia, PA): J. Hollander; University of Pittsburgh Medical Center (Pittsburgh, PA): A. Wolfson and J. Towers; and Vanderbilt University Medical Center (Nashville, TN): V. Norton.
| FOOTNOTES |
|---|
Address correspondence to Jennifer A. Oman, MD, 101 The City Drive South, Route 128, Orange, CA 92868. E-mail: jkrawczy{at}uci.edu
The authors have indicated they have no financial relationships relevant to this article to disclose.
* Refs 24, 6, 10, 1214, 19, 20, and 2325. ![]()
| REFERENCES |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
S. L. Bratton and R. I. Paul When to Use Computed Tomography in Minor Pediatric Head Trauma AAP Grand Rounds, August 1, 2008; 20(2): 14 - 15. [Full Text] [PDF] |
||||
![]() |
S. M. Atabaki, I. G. Stiell, J. J. Bazarian, K. E. Sadow, T. T. Vu, M. A. Camarca, S. Berns, and J. M. Chamberlain A Clinical Decision Rule for Cranial Computed Tomography in Minor Pediatric Head Trauma Arch Pediatr Adolesc Med, May 1, 2008; 162(5): 439 - 445. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||