Abstract
Background. Previous research investigating the relationship between the time of admission and mortality rates has yielded inconsistent results and has not been conducted in the pediatric intensive care unit (PICU) patient population.
Objective. To determine whether an association between the time of admission (weekday versus weekend and daytime versus evening) and the risk of death exists among pediatric patients included in a cohort of children admitted to a national sample of PICUs.
Design/Methods. We analyzed retrospectively a cohort of consecutive admissions to 15 PICUs included in the Pediatric Intensive Care Unit Evaluations database. The odds of death were analyzed by using mixed-effects, multivariate, logistic regression, with clustering at the hospital level. The primary independent variables were admission to the PICU on a weekend and admission to the PICU during evening hours. The severity of illness was adjusted by using the Pediatric Risk of Mortality III probability of death score.
Patients. All 20 547 emergency PICU admissions made between May 1995 and December 2001 were included in the analyses.
Main Outcome Measures. The primary outcome was death within 48 hours after admission to the PICU.
Results. Pediatric patients admitted to the PICU during evening hours had higher odds of death (odds ratio [OR]: 1.28; 95% confidence interval [CI]: 1.00-1.62) than did those admitted during daytime hours. Subgroup analyses revealed higher odds of death among patients admitted with shock (OR: 4.09; 95% CI: 1.65–10.1), with congenital cardiovascular disease (OR: 3.90; 95% CI: 1.37–11.1), or after cardiac arrest (OR: 1.80; 95% CI: 1.04–3.13). There was no association between mortality rates and the day of admission (weekend admissions versus weekday admissions).
Conclusions. An increased risk of death exists for some pediatric patients admitted to the PICU during evening hours. It remains necessary to determine whether this finding results from differences in the structure of care, processes of care, or both.
To improve the quality of care, discrepancies in health care delivery and their effects on patient outcomes must be identified. Recent research has demonstrated that, among large patient cohorts, differences in time of admission are associated with differences in patient outcomes. Bell and Redelmeier1 identified a significantly higher mortality rate among adult patients admitted on the weekend, compared with similar patients admitted on weekdays. Barnett et al,2 in a study of >150 000 adult patients admitted to 38 intensive care units (ICUs), demonstrated both a higher risk-adjusted odds of in-hospital death and a longer ICU length of stay for patients admitted on the weekend, compared with patients admitted on weekdays. Similarly, neonatal mortality rates were shown to be slightly higher among infants born on weekends and during evening hours, compared with those born on weekdays and during daytime hours, respectively.3–8 Whether an association exists between patient outcomes and time of admission in the pediatric patient population is unknown.
To address this question, the Pediatric Intensive Care Unit Evaluations (PICUEs) database, representing a cohort of 34 993 pediatric ICU (PICU) patients from 15 institutions in the United States, was analyzed.9 The objectives of this study were to compare the risk-adjusted mortality rates for weekend admissions versus weekday admissions and the risk-adjusted mortality rates for evening admissions versus daytime admissions.
METHODS
Patients
Data for analysis were obtained from the most current available PICUEs database, Research Dataset 20–02.9 This database contains patient-level data from 34 993 admissions to 15 PICUs in the United States. Details of the site-selection procedures for the 15 study sites, general data-collection methods, and other analyses of this data set have been published.9,10 Briefly, a minimum of 67 demographic, diagnostic physiologic, laboratory, and outcome data points were collected for all patients within 24 hours after admission to the PICU. Data for these analyses were collected for consecutive admissions between May 1995 and December 2001. Patients excluded from the database were patients admitted to the PICU for recovery from procedures usually cared for at other hospital locations, patients staying in the ICU <2 hours, and patients admitted in a state of continuous cardiopulmonary resuscitation. All data included in the database met quality standards, as assessed by data reabstraction and reliability testing.
The database includes data on 20 547 emergency admissions and 14 446 elective admissions, as defined by the Pediatric Risk of Mortality (PRISM)/PICUEs criteria. We limited our analyses, a priori, to patients admitted on an emergency basis, because we thought that their outcomes would be most sensitive to time variations in structure (eg, staffing levels) and processes (ie, the specific clinical activities performed) of care.11
Study Design
The primary outcome variable for these analyses was death within 48 hours after admission to the PICU. Only deaths that occurred within 48 hours after admission were considered, because such deaths were more likely to be attributable to differences during the initial hours after admission (eg, death resulting from shock is more sensitive to care during the initial 24 hours after admission, whereas death occurring days to weeks after admission is more likely to be attributable to complications of care or hospital-acquired infections).1,2,12 The primary independent variables were admission to the PICU on a weekend and admission to the PICU during the evening hours. Weekend admissions were defined as admissions to the PICU between 7 pm Friday and 7 am Monday. Evening admissions were defined as admissions between 5 pm and 7 am.
Other independent variables included as covariates were previous PICU admission during the current hospitalization, postoperative status, transfer from the inpatient ward, and use of vasoactive medications or ventilation within 24 hours after admission. The severity of illness was adjusted by using the PRISM III probability of death.9,10 PRISM III is a third-generation mortality-prediction algorithm based on individual patient demographic, physiologic, and laboratory data9,13 and is used to adjust for differences in mortality risk when comparing different populations of patients. The natural logarithm of the PRISM III probability of death was entered into the analyses as a quadratic transformation because of its curvilinear relationship with the observed logarithm of the odds of death.
Subgroup analyses were conducted on primary admission diagnoses according to the PRISM/PICUEs admission categories, including asthma, cancer, cardiac arrest, diabetic ketoacidosis, drug overdose, congenital cardiovascular disease, acquired cardiovascular disease, acute hypoxic ischemic encephalopathy, medical device malfunction, meningitis, pneumonia/bronchiolitis, seizure, sepsis, shock, suicide attempt, and trauma. These analyses were conducted to assess differences in mortality rates among individual diagnoses and were performed only for diagnoses with at least 100 patients and ≥10 deaths.14,15 Primary admission diagnoses from PRISM/PICUEs that were not included were gastroesophageal reflux, human immunodeficiency virus, chromosomal abnormality, solid-organ transplantation, and “other.”
Analyses
Univariate analyses of continuous variables were conducted with Student's t test or the Mann-Whitney U test, when appropriate. Univariate analyses of dichotomous variables were conducted with the χ2 test or Fisher's exact test, when appropriate. The odds of death within 48 hours were analyzed by using mixed-effects, multivariate, logistic regression, with clustering at the hospital level.16 Although hospital names were anonymous, each patient in the database was identified with a unique hospital code to allow statistical clustering of patients from the same institution. The adjusted odds ratios (ORs) are reported with 95% confidence intervals (CIs). Statistical significance was defined as P < .05. All calculations were performed by using Stata version 7 software (Stata, College Station, TX).
Human Subject Protection
This study was reviewed and approved by the University of California, Davis, Office for Human Subjects Protection.
RESULTS
Univariate Analyses
There were 20 547 pediatric patients admitted to the 15 PICUs on an emergency basis, and 7052 (34.3%) were admitted on weekends (Table 1). Compared with patients admitted on weekdays, patients admitted on weekends were slightly older (6.1 vs 5.8 years, P = .01), less likely to be admitted postoperatively (8.4% vs 10.2%, P = .01), less likely to have experienced a previous PICU admission (3.4% vs 4.0%, P = .04), and less likely to have received vasoactive medications within 24 hours after admission (16.0% vs 17.1%, P = .04). There was no difference between weekend and weekday admissions regarding the severity of illness (mean PRISM III scores of 5.7 vs 5.9, P = .12).
Baseline Patient Characteristics*
Patients admitted during the evening (n = 12 746, 62%), compared with those admitted during the daytime (n = 7801, 38%), were more likely to be male (57.8% vs 56.4%, P = .04) and were older (6.1 vs 5.6 years, P < .01) but were less likely to have experienced a previous PICU admission (3.0% vs 5.2%, P < .01), received vasoactive medications within 24 hours after admission (15.1% vs 19.5%, P < .01), or received mechanical ventilation within 24 hours after admission (34.5% vs 38.4%, P < .01). Patients admitted during the evening demonstrated a lower mean PRISM III score, compared with those admitted in the daytime (mean PRISM III scores of 5.5 vs 6.3, P < .01) (Table 1).
Table 1 demonstrates that the unadjusted overall PICU mortality rates were not statistically different for patients admitted on weekends and patients admitted on weekdays (4.71% vs 4.71%, P = .99). Similarly, there was no statistical difference in the rates of death within 48 hours after admission between the groups (2.28% vs 2.17%, P = .61). As shown in Table 2, the primary diagnoses for the weekend and weekday groups were trauma (20% vs 16%, P < .01) and asthma (10.0% vs 8.8%, P = .05). Overall, there were proportionately more admissions because of trauma, asthma, seizures, and drug overdoses on weekends. On weekdays, proportionately more patients were admitted with the diagnoses of cancer, congenital cardiovascular disease, acquired cardiovascular disease, and sepsis.
Primary Admission Diagnoses*
In a comparison of evening admissions and daytime admissions, the unadjusted overall PICU mortality rates (4.59% vs 4.91%, P = .29) and rates of death within 48 hours (2.24% vs 2.15%, P = .67) were not statistically different. As shown in Table 2, the most common diagnoses for evening and daytime admissions were trauma (20% vs 12%, P < .01) and pneumonia/bronchiolitis (13% vs 15%, P < .01). In addition, there were proportionately more admissions because of asthma and congenital cardiovascular disease during the daytime, compared with the evening, but proportionately more admissions because of seizures and drug overdoses during the evening, compared with the daytime.
Multivariate Analyses
Mixed-effects, multivariate, hierarchical, logistic regression was used to adjust for age, gender, a quadratic transformation of the logarithm of the PRISM III probability of death, previous PICU admission, postoperative care status, patient transfer status, and the requirement for vasoactive medications or ventilation within 24 hours after admission. The odds of death within 48 hours after admission for patients admitted on weekends was not higher than that for patients admitted on weekdays, as shown in Table 3 (OR: 1.00; 95% CI: 0.78–1.28). Furthermore, in the subgroup analyses there was no diagnosis with a different odds of death when weekend admissions were compared with weekday admissions (Table 4).
Results of Multivariate Hierarchical, Logistic Regression Predicting Death Within 48 Hours After Admission
Results of Multivariate Hierarchical, Logistic Regression Predicting Death Within 48 Hours After Admission for Diagnoses With >10 Deaths*
However, similar analyses demonstrated that pediatric patients admitted during evening hours had a higher odds of death than did patients admitted during the daytime hours (OR: 1.28; 95% CI: 1.00–1.62), after adjustment for the severity of illness and other covariates (Table 3). In the subgroup analyses (Table 4), we found higher odds of death among patients admitted with shock (OR: 4.09; 95% CI: 1.65–10.1), with congenital cardiovascular disease (OR: 3.90; 95% CI: 1.37–11.1), or after cardiac arrest (OR: 1.80; 95% CI: 1.04–3.13). Other diagnosis-specific analyses did not demonstrate significantly different mortality rates when evening admissions were compared with daytime admissions.
DISCUSSION
In our investigation of 20 547 patients admitted to the PICU on an emergency basis, there was no difference in the odds of death within 48 hours after admission between patients admitted on weekends and patients admitted on weekdays, after adjustment for the severity of illness. However, there was a 28% higher odds of death within 48 hours after admission when patients were admitted during evening hours, compared with daytime hours. The subgroup analyses revealed higher odds of death particularly among patients admitted with shock (OR: 4.09; 95% CI: 1.65–10.1), with congenital cardiovascular disease (OR: 3.90; 95% CI: 1.37–11.1), or after cardiac arrest (OR: 1.80; 95% CI: 1.04–3.13).
Our finding of higher odds of death among nighttime admissions is consistent with similar studies in other patient populations.17–20 Heller et al21 performed a large (>350 000 births) observational study in Germany, in which “low-risk” infants born at night (9 pm to 7 am) were twice as likely to die (OR: 1.86; 95% CI: 1.10–3.13) than were those born during the daytime (7 am to 9 pm). Similarly, higher odds of nighttime perinatal death (OR: 2.18; 95% CI: 1.37–3.47) was found in a study of >100 000 births in Wales.22 Stephansson et al18 also noted an increased risk of early neonatal death among nighttime births, after adjustment for the type of delivery and other confounders. Finally, in a recent, single-center, retrospective study of 6034 adult-patient admissions to an ICU, increased mortality rates were noted among those admitted at night.23
It is noteworthy that the increased risk of death among nighttime admissions was evident only after the analyses were adjusted for the severity of illness and that the increased risk of death was found primarily among 3 diagnosis subgroups. The former observation is an important methodologic consideration for the design and comparison of studies and depends on the quality of the tool used to assess the severity of illness. The PRISM III risk of death score is ideally suited for this purpose. For instance, in our database, patients with shock, congenital cardiovascular disease, or cardiac arrest represented 3 of the 5 diagnoses with the highest mean PRISM III scores and highest PRISM III predicted mortality rates. It remains important to prospectively test whether this observation results from differences between daytime and nighttime admission with respect to structure of care (staffing), process of care (behavior, fatigue), or both.
Our analysis did not identify an increased risk of death among pediatric patients admitted on weekends, compared with those admitted on weekdays, nor did the subgroup analysis reveal different outcomes for the 16 specific diagnoses evaluated. These results are also consistent with a recent study of neonatal mortality rates that used multivariate logistic regression to adjust for the severity of illness and the case mixture.24 Although earlier neonatal studies noted higher weekend mortality rates, those analyses likely did not adjust adequately for potential confounders.4,6–8
Interestingly, the lack of a weekend effect in the current study and the recent neonatal study24 differs from the results observed by Bell and Redelmeier,1 who evaluated mortality rates among adult emergency admissions between 1988 and 1997 in Ontario, Canada. The difference between these findings may represent differences between adult and pediatric patient populations or a distinction between the structure or processes of health care for adult versus pediatric patients. Alternatively, the disparity may result from differences in the ability of the PRISM III probability of death score and the Charlson comorbidity index used in the latter study to adequately adjust for the severity of illness. PRISM III mortality predictions are based on detailed, patient-level, demographic, physiologic, and laboratory data, whereas the Charlson comorbidity index relies on International Classification of Diseases categories.25,26 The use of administrative databases without physiologic or laboratory data has been shown to adjust inadequately for the severity of illness and the risk of death.14,15
There are limitations of the present study. First, deaths before admission to the PICU were not included in the analysis. Exclusion of deaths that occurred either “in the field” or in the emergency department could have underestimated the mortality rates for certain primary diagnoses such as trauma.27 Second, specific information on family preferences regarding therapy or refusal of certain treatment modalities, which could affect patient outcomes, was absent from the database. Third, PICU-specific information regarding differences in staff and physician coverage was not present in the database and might independently influence mortality rates.28,29 Last, the 15 PICUs in our analysis may not be nationally representative.
It remains important to determine the factors underlying the association between the time of admission and mortality rates as well as apparent differences between the results of recent reports. For instance, in the present study there were 28% more admissions per hour during evening hours, compared with daytime hours, and 6% fewer admissions per hour during weekend hours, compared with weekday hours. It is unclear whether the present findings are attributable to the observed admission densities or the increased human-error rates during evening hours, as reported in both medical and nonmedical fields.30–33 Nevertheless, it is possible to assess prospectively whether changes in the structure of care, process of care, or a combination thereof could negate the observed differences in mortality rates between daytime and nighttime admissions to the PICU.
CONCLUSIONS
Independent data for pediatric, neonatal, and adult patients now identify an association between the time of admission and mortality rates. Although the current study found no association between mortality rates and the day of admission, pediatric patients admitted to the PICU during evening hours had higher odds of death than did those admitted during daytime hours. It remains important to discern the basis of these observations (which will remain an important area of investigation) to maintain a consistent high quality of medical care.
Acknowledgments
This work was supported in part by the University of California, Davis, Children's Hospital Children's Miracle Network.
Footnotes
- Received September 2, 2003.
- Accepted January 28, 2004.
- Reprint requests to (J.P.M.) University of California, Davis, Medical Center, 2516 Stockton Blvd, Sacramento, CA 95817. E-mail: jpmarcin{at}ucdavis.edu
REFERENCES
- Copyright © 2004 by the American Academy of Pediatrics