


Departments of * Pediatrics
Internal Medicine and the Cardiovascular Research Center
Health Evaluation Sciences, University of Virginia Health System, Charlottesville, Virginia
|| Department of Biostatistics, Vanderbilt University, Nashville, Tennessee
¶ Department of Pediatrics, Wake Forest School of Medicine, Winston-Salem, North Carolina
| ABSTRACT |
|---|
|
|
|---|
Methods. We monitored 1022 infants at 2 tertiary care NICUs, 458 of whom were very low birth weight. We calculated an HRC index from validated regression models relating mathematical features of heart rate time series and histograms to episodes of illness. We calculated the risks for adverse events of sepsis, UTI, and death for infants stratified by HRC measurements.
Results. Compared with infants with low-risk HRC measurements, infants with high-risk HRC measurements had 5- to 6-fold increased risk for an adverse event in the next day and 3-fold increased risk in the next week. Laboratory tests that were relevant to infection added information to HRC measurements. Infants with both high-risk HRC and abnormal laboratory tests had 6- to 7-fold increased risk for an adverse event in the next day compared with infants who had neither.
Conclusion. HRC are noninvasively monitored physiomarkers that identify infants in the NICU who are at high risk for sepsis, UTI, and death.
Key Words: infant mortality prediction sepsis urinary tract infections physiomarker
Abbreviations: HRC, heart rate characteristics UTI, urinary tract infection UVA, University of Virginia HR, heart rate WFU, Wake Forest University CONS, coagulase-negative Staphylococcus NICHD, National Institute of Child Health and Human Development VLBW, very low birth weight
The common clinical scenario of abrupt deterioration of a stable infant in the NICU usually prompts the consideration of sepsis. Establishing the diagnosis of neonatal sepsis using current clinical and laboratory methods, though, is difficult.1,2 Even when tests are performed at the time that the infant is obviously ill clinically, there is no consensus about diagnostic clinical or laboratory findings.35 Blood cultures, which should be the final arbiter in the diagnosis of bacteremia, are not reliable in this clinical setting, where very small amounts are usually obtained for testing.69 Bacteremia, moreover, may be transient and intermittent.
Abnormal heart rate characteristics (HRC) of reduced variability and transient decelerations occur early in the course of neonatal sepsis.1012 We previously developed algorithms to detect these HRC and showed significant association of them with sepsis10 and with death11 at 2 university tertiary care referral NICUs. Here, we evaluate continuous neonatal HRC monitoring as a clinical tool to identify infants who are at increased risk for having sepsis, urinary tract infection (UTI), or death in the NICU.
| METHODS |
|---|
|
|
|---|
We continuously monitored heart rate (HR) from the bedside electrocardiogram monitors and calculated the HRC index every 6 hours. The HRC index is derived from a multivariable logistic regression model that relates HR statistics to acute neonatal illness in the next 24 hours. The model was initially generated at UVA using data from 316 of the study infants and validated at WFU on 317 of the study infants.12 The HR parameters of SD, sample asymmetry,13 and sample entropy14,15 report on reduced variability and transient decelerations that occur early in the course of neonatal sepsis.10 Model coefficients and predictive performance were similar whether the outcome variable was proven sepsis or suspected sepsis or whether the time window was the day before or the day of the event. All models that were generated at 1 site could be validated at the other.
We defined "adverse events" as sepsis, UTI, and death. We defined "sepsis" to be present when a physician suspected the diagnosis, obtained a blood culture that grew bacteria not ordinarily considered to be a contaminant, and initiated antibiotic therapy of 5 days' duration or more. This definition is consistent with the diagnosis of "proven sepsis" offered by the Centers for Disease Control and Prevention.16 For infections with coagulase-negative Staphylococcus (CONS), our definition is consistent with the National Institute of Child Health and Human Development (NICHD) Neonatal Research Network definition of possible CONS sepsis.17 We defined UTI to be present when a physician detected signs of illness, obtained a urine sample from a catheter or suprapubic aspiration that grew bacteria, and initiated antibiotic therapy. An abnormal laboratory result was considered to be present when leucocytosis or leucopenia (white blood cell count >20000/µL or <5000/µL), high proportion of circulating immature neutrophils (I:T ratio >0.2), thrombocytopenia (platelet count <100000/µL), or hyperglycemia (blood glucose >180 mg/dL) were recorded within the previous 24 hours.
Statistical Analysis
The HRC index is a continuous measure. To facilitate clinical application of the HRC index, we defined 3 levels of risk on the basis of the model values. The lowest 70% of HRC measurements were less than or equal to the mean value and thus corresponded to a relative risk of 1 or less for acute neonatal illness in the next 24 hours. We categorized these as low risk. Ninety percent of values were less than or equal to twice the mean value, so values between the 70th and 90th percentiles correspond to 1- to 2-fold increase in relative risk, and we categorized these as intermediate risk. HRC values above the 90th percentile correspond to 2-fold and higher risk, and we categorized these as high risk.
The population-based distribution of HRC index is approximately log-normal at the 2 sites but shifted to higher values at WFU.12 We attribute this to a higher level of illness severity at WFU, which, unlike UVA, has no in-born patients and admits only infants who are referred from other hospitals. The proportion of extremely low birth weight infants (<750 g) is higher at WFU, and there was a trend toward higher mortality rate (7% vs 4%).11 Accordingly, HRC index values were assigned to percentiles of the distribution for each site.
Because of the continuously repeated measures, statistical inference was performed using a cluster bootstrap technique whereby 1000 new samples of the same size were obtained by resampling the infants with replacement.18 The 2.5th and 97.5th percentiles of the sample of risks are used as lower and upper limits for a 95% confidence interval around the observer risk in the original sample. The P value to measure the statistical significance of increased risk is evaluated by the proportion of resampled observations with risk
1.
| RESULTS |
|---|
|
|
|---|
|
|
25 minutes, depending on the HR, were collected, and HRC parameters were calculated on each epoch. The plots show the SD, sample asymmetry, and sample entropy of each of the 26 4096-beat epochs recorded in the 12 hours shown. The abnormalities or interest are low SD (reduced variability), high sample asymmetry (transient decelerations), and low sample entropy (both). The goal is to detect intermittent abnormal records without overreporting of very transient abnormalities that might be attributable to innocuous interventions such as feeding. Our approach is to summarize some of the measures by their extremes and others by the median. Using extreme values allows the HRC index to change quickly (2 or 3 consecutive abnormal records have a perceptible effect). Using median values smooths the response.
The labeled data points in Fig 1B to D are the 10th percentile values of SD (point X) and sample entropy (point Z) and the median sample asymmetry (point Y). The expression below the plots shows how these values are weighted and combined to yield the HRC index. The weights, expressed as the coefficients ß, and their statistical significance are determined by regression analysis.12 The HRC index for this 12-hour period was >2-fold higher than average, indicating >2-fold increase in risk.
HRC Predicts Sepsis and UTI in Infants in the NICU
We examined the relationship of HRC measurements with the incidence of adverse events over the next 7 days. For each HRC measurement, infants were placed into high-, intermediate-, and low-risk groups. Figure 2A shows the cumulative incidence of adverse events as a function of time. The separation of the confidence intervals indicates significant differences among the risk groups at the level of P < .001. Figure 2B shows the risk for events relative to the average risk. Infants with measurements in the low-risk group had less than the average risk, whereas those in the intermediate- and high-risk groups had above-average rates. The relative risk of an adverse event was nearly 3-fold higher than average in the high-risk group for the first 24 hours and remained >2-fold higher for a week. Compared with the low-risk group, the high-risk group had a 5- to 6-fold increase in risk of an event in the next 24 hours and a 3- to 4-fold increase for 1 week.
|
Combining HRC and Laboratory Tests to Predict Adverse Events in VLBW Infants
Laboratory tests that are relevant to infection are the current tools for diagnosing neonatal sepsis and UTI, and we investigated how HRC monitoring might add information in the VLBW population. In VLBW infants after 1 week of age at UVA, 82% of 6-hourly epochs had neither high HRC nor an abnormal laboratory result, 15% had either high HRC or an abnormal laboratory result, and 3% had both. Figure 2C shows how HRC and laboratory tests influence the incidence rates of an adverse outcome during the next 7 days. For example, the group with high HRC and an abnormal laboratory test had a 11% incidence of adverse outcome at day 3 compared with 2.0% in the group with normal HRC and no abnormal laboratory test.
Figure 2D shows the relative risk of high HRC with an abnormal laboratory test compared with high HRC without an abnormal test. There was a 6- to 7-fold increase in risk in the first day that remained 3-fold at 1 week.
Overall Evaluation of the Predictive Model
Figure 3 compares the predicted and observed increases in risk of an adverse event using a predictive model that was generated on the entire data set of 1022 infants. Intermediate- and high-risk groups are shown as shaded boxes bounded by 95% confidence intervals. There is good agreement between predicted and observed increases in risk and a steep increase in predicted and observed risk of event in the high-risk group.
|
| DISCUSSION |
|---|
|
|
|---|
We evaluated continuous monitoring of HRC in 2 NICUs using a previously validated algorithm to detect reduced variability and transient decelerations. Our new major findings are as follows: (1) the relative risk of an adverse event of sepsis, UTI, or death is severalfold higher in the high-risk group compared with the low-risk group; and (2) HRC monitoring adds information to abnormal laboratory tests.
HRC monitoring in the NICU differs from other forms of HR monitoring such as fetal monitoring. The HRC index is quantitative and based on occurrence of observed episodes of illness in a large population. It is a continuous risk-assessment measure presented as the fold increase in probability of an event. Many infections have subacute onset, and the HRC changes hours to days in advance of severe symptoms.11,12 The intervention, antibiotics, is generally assumed to be more effective when started early.
HRC monitoring seems to meet methodologic standards defined by Feinstein et al22 for assessing new tests. There should be a satisfactory spectrum of population (all NICU admissions), analysis of subgroups (VLBW), no work-up or review bias (clinicians blinded to results during model development and validation), confidence intervals (for fold increase in risk), indeterminate results handled correctly (no indeterminate results), and test reproducibility (robust performance of predictive models with varying outcomes and time windows, all generated at 1 NICU and validated at another).
HRC monitoring also meets more recent and specific guidelines proposed for evaluation of new screening tests.23,24 These include an ability to standardize (automated HR analysis from bedside monitor), independence from established risk factors (adds information to birth weight, gestational age, and days of age),11,12 association with clinical endpoints (sepsis, UTI, and death), population norms (this and previous work11,12), ability to improve prediction over traditional risk factors (adds information to laboratory tests, birth weight, gestational age, and days of age), generalization to population groups (HRC index generated at 1 NICU and validated at another),12 and acceptable cost (uses existing electrocardiogram monitor data: no new contact with patient required).
Figure 2A and C shows the predictive accuracy of HRC monitoring. If a single high-risk HRC measurement is considered to be a "positive" test for impending proven sepsis, UTI, or death in the next week, then the positive predictive value is 15%. This increases to 20% if an abnormal laboratory test is also present. If a single low-risk HRC result is considered to be a "negative" test, then the negative predictive value is 95%. The problems with this perspective are well known. First, information is lost when thresholds are used (what if white blood cell and blood glucose results were limited to "positive" or "negative"?). Second, positive predictive values are low for infrequent events such as neonatal sepsis and death.5 Laboratory tests for sepsis are usually performed in symptomatic patients, who thus have a higher pretest probability of illness than the infants here, for whom the testing was continuous. Finally, the intent of HRC monitoring is to identify infants with increasing risk so that physicians can evaluate them, not to make a definitive diagnosis.
There are limitations to HRC monitoring. Illnesses other than sepsis and UTI can lead to elevated cytokine levels and thus, in our view,10 to abnormal HRC. We have noted cases of elevated HRC index in which there was no suspected or documented sepsis or UTI. Instead, there were other important new diagnoses, including acute respiratory failure, exacerbations of chronic lung disease, intraventricular hemorrhage, and necrotizing enterocolitis. HRC are almost always abnormal immediately after surgery. Undoubtedly, there are still other illnesses that may cause abnormal HRC and are not attributable to infection. There inevitably will be epochs of abnormal HRC that go unexplained. Sometimes these recur and escalate, and clinical illness eventually declares itself, as we have previously shown.12 Moreover, we find that infants with chronic severe respiratory illness, for example, have persistently elevated HRC index in the absence of acute deteriorations. Although abnormal HRC may not be specific for sepsis and UTI, these remain common causes for abnormal monitoring results and ones for which early diagnosis and therapy should be especially helpful.
We conclude that the HRC index holds useful clinical information about risk stratification in the NICU. Moreover, it adds information to abnormal values of common laboratory tests that are relevant to neonatal sepsis. It has the advantage of being noninvasive and continuous, unlike current laboratory tests, which are intermittent and require a blood sample. Continuous HRC monitoring has potential for alerting medical personnel in advance of overt clinical illness in the NICU. More generally, monitoring of regulated physiologic processes using physiomarkers such as HRC may be important in the early diagnosis of many subacute, potentially catastrophic illnesses.
| ACKNOWLEDGMENTS |
|---|
| FOOTNOTES |
|---|
Reprint requests to (J.R.M.) Cardiovascular Division, Box 801395, University of Virginia, Charlottesville, VA 22908. E-mail: rm3h{at}virginia.edu
Conflict of interest: Medical Predictive Science Corporation of Charlottesville, VA, has a license to market technology related to heart rate characteristics monitoring of newborn infants, and supplied partial funding for this study. Drs Griffin and Moorman have an equity share in this company.
| REFERENCES |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
V. Bhandari, C. Wang, C. Rinder, and H. Rinder Hematologic Profile of Sepsis in Neonates: Neutrophil CD64 as a Diagnostic Marker Pediatrics, January 1, 2008; 121(1): 129 - 134. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. El-Khatib Physiomarkers of Neonatal Heart Rate Pediatrics, May 1, 2006; 117(5): 1853 - 1854. [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||