
,
,¶
* Department of Neonatology, Beth Israel Deaconess Medical School, Boston, Massachusetts
Division of Newborn Medicine, Harvard Medical School, Boston, Massachusetts
Department of Maternal and Child Health, Harvard School of Public Health, Boston, Massachusetts
|| Department of Clinical Epidemiology and Biostatistics, McMaster University, Hamilton, Ontario, Canada
¶ Department of Neonatology, Brigham and Womens Hospital, Boston, Massachusetts
# Center for Risk Analysis, Harvard School of Public Health, Boston, Massachusetts
| ABSTRACT |
|---|
|
|
|---|
Methods. Using computer simulation, we compared the alternatives of hospital monitoring for 1 to 10 days, after apparent cessation of apnea, with no monitoring and with the next longest period of monitoring. The daily probability of apnea requiring stimulation after a given number of apnea-free days was obtained from chart review of 216 infants, beginning on the day they attained both full feeds and temperature stability in an open crib. Baseline rates of survival or impairment, utilities for calculation of quality-adjusted life years (QALYs), outcomes for respiratory arrest at home, and long-run costs for neurodevelopmental impairment were derived from the literature. Hospital expenditures were obtained from itemized billing records for infants on each of the final 10 days of hospitalization and converted to costs using Medicare cost-to-charge ratios. Costs are reported in 2000 US dollars.
Results. For infants born at 24 to 26 weeks gestation, each additional day of monitoring cost from $41000 per QALY saved for the first day to >$130000 per additional QALY gained for the tenth day. Cost-effectiveness was poorer for infants who were born at gestational ages >30 weeks. Results were sensitive to the proportion of charted apneas requiring stimulation that would actually progress, without intervention, to respiratory arrest.
Conclusions. In this model, the cost-effectiveness of predischarge monitoring for apnea of prematurity declined significantly as the duration of monitoring was increased. Consideration should be given to alternative uses for resources in formulating neonatal discharge guidelines.
Key Words: economics resource utilization infant newborn decision analytic modeling cost analysis apnea of prematurity
Abbreviations: NICU, neonatal intensive care unit QALY, quality-adjusted life year
| INTRODUCTION |
|---|
|
|
|---|
Apnea of prematurity is almost universal in infants before approximately 28 weeks postmenstrual age, then gradually becomes less frequent with maturation of the central nervous system through 35 to 36 weeks postmenstrual age, although group differences in the incidence of cardiorespiratory events persist to approximately 43 weeks postconceptional age.2 Apneic episodes may range in severity from those that resolve spontaneously, through episodes that require stimulation of the infant to reestablish respiratory effort, to severe events requiring artificial ventilation or resuscitation. The disorder is treated with mechanical ventilation at its most acute stage and with medication. During the marginal period before discharge, however, episodes usually fall at the less severe end of the spectrum, and infants are simply monitored off medication using a device that alarms when the heart or respiratory rates fall below a defined threshold. This monitoring continues until the infant is deemed "mature," that is, has remained asymptomatic for between 3 and 10 days, with the exact duration varying significantly between institutions.3 At this point, it is believed that the likelihood of recurrent apnea is exceedingly remote, and the infant is discharged. Because of the prolonged duration of monitoring, this is often the only reason that the infant must remain in the hospital and thus may be an important determinant of costs related to length of stay.
There are no studies that establish either the efficacy or the cost-effectiveness of the various durations of monitoring. This is presumably because adverse outcomes are rare, and the length of the monitoring period in most institutions is very conservative; direct investigation therefore would require very large cohorts and a major change in practice and might raise ethical issues of randomizing infants to lesser treatment. However, by making the assumptions that the rate of resolution of apnea after discharge is the same as that observed in the hospital and that nonself-resolving apneas at home would lead to respiratory arrest, the process can be modeled using decision-analytic methods.
| METHODS |
|---|
|
|
|---|
The analysis targeted infants at highest risk for apnea of prematurity, specifically those with gestational ages at birth of 24 to 34 weeks by best obstetric estimate. These infants were assumed to have received other aspects of care typical for hospitalized neonates in North American intermediate- and high-risk neonatal intensive care units (NICUs). As the decision for discharge on the basis of apnea of prematurity would apply only when other markers of developmental immaturity had resolved, only infants who had already achieved full oral feeds, who no longer required an incubator for external warming, and who were not receiving drug therapy for apnea were included in the analysis.
Physicians generally choose to discharge infants after a period of observation of 1 to 10 consecutive days without recorded apnea or bradycardia.3 The analysis compared each of these periods of monitoring with the next longest period of monitoring. A 0-day monitoring alternative was also included, as infants are occasionally discharged with active apnea of prematurity on cardiorespiratory monitors, for which the effectiveness in preventing death outside hospital has not been established.
To facilitate comparison with other health-related social programs, we used a societal perspective in deciding which costs and effects to measure. In this comprehensive viewpoint, all relevant costs and outcomes were considered, regardless of the parties to whom they accrued.4 Similarly, because the outcomes of neonatal respiratory arrest include chronic health states with long-term costs, a lifetime horizon was taken, in which all effects and costs of the alternative approaches to monitoring in the neonatal period were modeled, regardless of when they occurred.
Individuals usually prefer to receive benefits earlier and to defer costs so that resources can be put to other uses in the interim. For taking this time preference into account, future costs and effects are typically weighted less heavily through a "discount rate." In our study, costs and effects for the base case were discounted at 3% per year, and this value was varied between 0% and 5% in sensitivity analyses.4
Decision-Analytic Model
Events in the neonatal period were described with a state-transition decision-analytic model5 using the DATA 3.5.5 for Healthcare software package (TreeAge Software, Williamstown, MA). The structure of the decision-analytic model is shown in Fig 1 . The model is summarized below. Full details of structure and inputs are available in a technical report from the authors.6
|
Apneas that occur in the hospital are treated with stimulation of the infant by gentle patting or in more serious instances by bag-mask ventilation. Most hospitalized infants with apnea that is not self-resolving have no obvious adverse consequences on quality-adjusted life expectancy, because they receive immediate stimulation or, rarely, resuscitation and do not experience the effects of hypoxia. Thus, all infants who experience apnea in the hospital are modeled as simply restarting the apnea watch, without any increased risk for neurodevelopmental sequelae or death. In contrast, some proportion of apneas experienced at home would not resolve spontaneously. It is assumed that, without intervention, these would result in respiratory arrest. Because resuscitation is less successful and more delayed out of the hospital, there is a probability of both death and neurodevelopmental compromise, in addition to the gestation-specific risks.
Face validity of the model was assessed in several presentations to clinicians during its development. Technical accuracy was verified by using inputs for which results were obvious and predictable.7 The modeling exercise was undertaken because outcome data do not exist for varying duration of predischarge monitoring for apnea of prematurity; thus, predictive validity could not be assessed.
Sources for Costs
Daily costs for hospitalized infants were taken from patient-specific itemized charge records for 628 infants who were at 24 to 34 weeks gestation and were eventually discharged directly home from the Brigham and Womens Hospital NICU in 1990 and 1991. Charges were converted to costs using cost centerspecific Medicare ratios of costs to charges for the Brigham and Womens Hospital for 1991. Other cost variables are given in Table 1 and summarized below.
|
Costs for resuscitation were obtained from the clinician fee schedules at Childrens Hospital, Boston, in 1998. The resuscitation protocol was derived from typical clinical practice for unexplained infant respiratory arrest at home. Fees were adjusted by the average departmental collection fraction to reflect actual reimbursement. Costs of emergency medical response were obtained from the fee schedule of a nationally represented ambulance service.
Long-term direct medical costs for infants with neurodevelopmental sequelae were obtained from the cerebral palsy subgroup of an extensive cost of illness study of 18 birth defects.9 This study also included costs of educational and developmental interventions in the long term.
Expenditures such as parental travel costs and child care in the neonatal period were not included, as accurate information on these is not available from secondary sources. However, because these would be differential between the strategies for at most 10 days, the total sum is likely to be small relative to high daily hospital costs.
It was assumed that parents had returned to work in the predischarge period and that they took leave from work during the initial days with the infant at home. National average nonadjusted hourly earnings for production workers were applied to the expected number of weekdays spent at home by 1 parent.10
Costs were expressed in 2000 US dollars. When appropriate, currencies were converted between time periods using the medical care component of the Consumer Price Index.11
Sources for Probabilities and Effects
Input values for probabilities and effects, along with values for sensitivity analyses, are shown in Table 2 . Baseline mortality and morbidity outcomes for premature infants were derived from the literature1215 and from local data collected at the Brigham and Womens Hospital in 1996 and 1997 for 565 extremely low birth weight infants (A. Stark, Harvard Medical School, personal communication). Outcomes for infants who experience apnea at home were derived from published studies on out-of-hospital pediatric cardiorespiratory arrest.1618
|
No studies in the literature measure the probability of developing apnea after a given number of days without symptoms. Values for the probability of remaining asymptomatic between 1 day and the next were derived from a sample of 216 infants who were cared for in the Brigham and Womens Hospital NICU between 1993 and 1996. Characteristics of these infants are given in Table 3 . Standard practice in the NICU at that time included continuous cardiorespiratory monitoring of all infants throughout the admission. Apnea alarms occurred after 20 seconds of absence of respiratory effort, whereas bradycardia alarms typically were set for heart rates below 80 beats per minute. Infants were typically discharged when they had attained full feeds with adequate growth and temperature regulation and had had no cardiorespiratory events at rest for 5 days. In our study, the daily number of apneas that required stimulation was abstracted retrospectively from patient charts from the day these infants attained both full feeds and temperature stability in an open crib up to discharge. Results were stratified by gestational age, because there is some evidence of a slower resolution of apnea at lower gestations.19 The probabilities were then smoothed using logistic regression to eliminate the effects of sampling error. Figure 2 shows the smoothed curves for the 3 gestational age ranges.
|
|
error of 0.05 was selected as the baseline value for analyses.
Analysis and Statistical Considerations
The decision-analytic model was used to simulate baseline costs and effects for a cohort of infants in each of 3 gestational age categories: 24 to 26 weeks, 27 to 29 weeks, and 30 to 34 weeks. Incremental cost-effectiveness ratios were calculated as the additional cost of a period of monitoring, divided by the additional effectiveness, compared with the next longest period of monitoring.
For assessing the uncertainty associated with the results, 2 forms of analyses were then performed. In deterministic sensitivity analysis, values for input variables were varied through their plausible ranges (given in Tables 1 and 2), and the changes in the cost-effectiveness ratios were recorded. In probabilistic sensitivity analysis, random uncertainty associated with sampling of any variables that had probability distributions was assessed; this included, for example, variables such as hospital costs or apnea rates that were obtained from cohorts of real patients. The procedure involved randomly sampling from the distributions of each relevant input variable 1000 times and repeating the simulation each time to generate 1000 incremental cost-effectiveness ratios for each period of monitoring. The 975th and 25th largest cost-effectiveness ratios were selected from the ordered list to construct 95% confidence intervals.
| RESULTS |
|---|
|
|
|---|
|
|
As noted above, there was a trend toward poorer cost-effectiveness for infants in the more mature 30- to 34-week gestation cohort. Moreover, this group of infants is much more numerous, composing 80% of the 173000 births below 34 weeks in the United States (J. Martin, National Center for Health Statistics, personal communication, October 1997). If total NICU beds are constrained, then a rational economic policy might dictate putting more resources into monitoring less mature rather than more mature infants. Table 5 shows the implications of such differential monitoring for a hypothetical cohort of 1000 infants. Compared with the typical strategy of monitoring all infants for 5 days, a policy of monitoring infants of 30 to 34 weeks gestation for 4 days and those below 30 weeks gestation cohorts for 7 days would consume 453 fewer bed days, cost $621000 less, and generate 21 more QALYs. The differential policy is therefore dominant in that it both reduces costs and improves outcomes.
|
| DISCUSSION |
|---|
|
|
|---|
The model had several strengths not typically seen in pediatric modeling studies. These included the use of actual patient data for both costs and probability of apnea, adherence to a marginal approach for both costs and effects, and the use of simulation modeling to generate 95% confidence intervals.
Before consideration of the implications of the results, however, it is also important to understand the assumptions and limitations of the simulation approach. The model was based on 3 main structural assumptions and a number of assumptions regarding the individual inputs. The first structural assumption was that the rate of apnea in the hospital is the same as it would be if the infants were at home. Although this assumption cannot be tested formally, there is no biological rationale against it; in the few days before discharge, the observed infants did not receive any confounding interventions, such as drug therapy or respiratory support.
The second main assumption was that the outcome of respiratory arrest at home is the same as it would be for other causes unrelated to prematurity. In this case, because the literature outcomes are already very poor, using a worse outcome in sensitivity analyses had very little effect on the results, whereas using more optimistic outcomes tended to worsen the cost-effectiveness by up to 30%.
The final main assumption related to the rate of progression of apnea to full respiratory arrest. As noted in "Methods," this rate is not observable in the hospitalized sample, as apnea that seems to be persistent ("apnea requiring stimulation") always results in intervention, specifically gentle tactile stimulation. The rate was therefore inferred from the sample of infants who generated the apnea probabilities, by assuming that the observed 0 event rate was consistent with an
sampling error of 0.05. Although it is highly unlikely that any of these infants experienced a respiratory arrest at home without the involved clinicians being informed, it is conceivable that repeated samples of n = 216 might contain a case of an infant who died from arrest at home. In sensitivity analysis, there was a substantial improvement in cost-effectiveness ratios when the rate was assumed to be higher. However, even under this unlikely scenario, the cost-effectiveness of monitoring exceeded $50000 per QALY by 5 days in all 3 gestational age cohorts.
With regard to specific choices for input variables, sensitivity analyses showed the results to be very stable or moderately stable to changes in hospital costs, patient preferences for remaining in the hospital, physician and parent salaries, and baseline prematurity outcomes. However, there was substantial change in the cost-effectiveness ratios when the model assumed a 0 discount rate. This is not specific to apnea of prematurity: most interventions in which resources are used early to change later outcomesas is the case for almost every neonatal therapywill be more attractive when the later outcomes are not discounted. Moreover, the absence of a time preference is not consistent with empirical studies. Of note, varying the discount rate to 5%, as has been suggested in some pharmacoeconomic guidelines, resulted in a precipitous worsening of the cost-effectiveness.
Finally, it is possible that there is some selection bias in the observational component of the study. Infants who are discharged directly home from the tertiary care hospital rather than being transferred to a community hospital first may be sicker and thus more likely to have apnea. This would result in a higher rate of apnea, which would in turn lead to better cost-effectiveness ratios. Thus, if there were selection bias, then the results would underestimate rather than overestimate the true cost per QALY saved.
Another limitation is that this was a simulation study. Unfortunately, experimental or observational studies of appropriateness of in-hospital monitoring are exceedingly difficult to perform for apnea of prematurity for several reasons. These include the rarity of adverse events, entrenched clinical dogma regarding the monitoring period, and both ethical and medical/legal resistance to changing current practice to a less conservative approach. This resistance persists despite substantial equipoise when the literature is examined objectively. In the absence of more rigorous study designs for direct economic evaluation, the only alternative is to attempt to synthesize the available data in as transparent a manner as possible and generate estimates of cost-effectiveness that can be refined later.
It is apparent, then, that the exact values of the cost-effectiveness ratios must be taken with caution. However, the more general resultthat each additional day of monitoring results in steeply increasing incremental cost-effectiveness ratioswas robust. There are important policy implications to these findings. Although methodological differences cause potential problems in comparing cost-effectiveness ratios between studies,20 this range of cost-effectiveness is at or beyond the upper range for other accepted health interventions,21 particularly those in infant populations, such as hepatitis B immunization,22,23 neonatal intensive care,24 or its better-studied components, such as surfactant2529 or erythropoietin30 therapy. More important, the differences in cost-effectiveness across gestational age cohorts suggests that monitoring lower gestation infants for a longer period and higher gestation infants for a shorter period may result in better outcomes and decreased costs compared with the status quo. Such cost-saving policies are rare in neonatology, surfactant being the single well-studied example.2529
Although the results of modeling studies such as this one cannot guide a change in policy on their own, they do point to the high priority for additional research into high-volume, low-acuity care. Prospectively planned economic evaluation should be an integral component of any such research.
| ACKNOWLEDGMENTS |
|---|
| FOOTNOTES |
|---|
Reprint requests to (J.A.F.Z.) Department of Neonatology, Beth Israel Deaconess Medical Center, 330 Brookline Ave, Rose Bldg Rm 318, Boston, MA 02215. E-mail: zupancic{at}post.harvard.edu
| REFERENCES |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
J. Profit, M. C. McCormick, G. J. Escobar, D. K. Richardson, Z. Zheng, K. Coleman-Phox, R. Roberts, and J. A.F. Zupancic Neonatal Intensive Care Unit Census Influences Discharge of Moderately Preterm Infants Pediatrics, February 1, 2007; 119(2): 314 - 319. [Abstract] [Full Text] [PDF] |
||||
![]() |
N. O. ElHassan, M. E. S. Sorbero, C. B. Hall, T. P. Stevens, and A. W. Dick Cost-effectiveness Analysis of Palivizumab in Premature Infants Without Chronic Lung Disease. Arch Pediatr Adolesc Med, October 1, 2006; 160(10): 1070 - 1076. [Abstract] [Full Text] [PDF] |
||||
![]() |
J Profit, J A F Zupancic, M C McCormick, D K Richardson, G J Escobar, J Tucker, W Tarnow-Mordi, and G Parry Moderately premature infants at Kaiser Permanente Medical Care Program in California are discharged home earlier than their peers in Massachusetts and the United Kingdom Arch. Dis. Child. Fetal Neonatal Ed., July 1, 2006; 91(4): F245 - F250. [Abstract] [Full Text] [PDF] |
||||
![]() |
I. Griebsch, J. Coast, and J. Brown Quality-Adjusted Life-Years Lack Quality in Pediatric Care: A Critical Review of Published Cost-Utility Studies in Child Health Pediatrics, May 1, 2005; 115(5): e600 - e614. [Abstract] [Full Text] [PDF] |
||||
![]() |
Z. A. Bhutta, G. L. Darmstadt, B. S. Hasan, and R. A. Haws Community-Based Interventions for Improving Perinatal and Neonatal Health Outcomes in Developing Countries: A Review of the Evidence Pediatrics, February 1, 2005; 115(2/S1): 519 - 617. [Abstract] [Full Text] [PDF] |
||||
Read all P3Rs
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||