
,
* Department of Pediatrics, Childrens Hospital of Eastern Ontario, Ottawa, Ontario, Canada
Childrens Hospital of Eastern Ontario Research Institute, University of Ottawa, Ottawa, Ontario, Canada
Chalmers Research Group, University of Ottawa, Ottawa, Ontario, Canada
|| Management Information Services Childrens Hospital of Eastern Ontario, Ottawa, Ontario, Canada
¶ Pharmacy Department, Childrens Hospital of Eastern Ontario, Ottawa, Ontario, Canada
| ABSTRACT |
|---|
|
|
|---|
Design. A retrospective cohort study.
Setting. Tertiary care pediatric hospital.
Participants. Pediatric inpatients on 3 medical and 2 surgical wards.
Intervention. CPOE system implemented on 2 medical wards and compared with 1 medical and 2 surgical wards that continued to use hand written orders.
Outcome Measures. Rate of medication error and ADEs before and after CPOE implementation.
Results. In 6 years, a total of 804 medication errors were identified with 18 ADEs, resulting in patient injury among 36 103 discharges and 179 183 patient days. The overall medication error rate (MER) was 4.49 per 1000 patient days. Before the introduction of CPOE, the MERs of the intervention versus control wards were indistinguishable (ratio = 0.93; 95% confidence interval [CI] = 0.76, 1.13). After the introduction of CPOE, the MER was 40% lower on the intervention than on the control wards (ratio = 0.60; 95% CI = 0.48, 0.74). On average, 490 patient days are required to see the benefit of one less medication error using CPOE. We did not demonstrate a similar effect of CPOE for ADEs (ratio of rate ratios = 1.30; 95% CI 0.47, 3.52).
Conclusions. The introduction of a commercially available physician computer order entry system was associated with a significant decrease in the rate of medication errors but not ADEs in an inpatient pediatric population.
Key Words: computerized physician order entry inpatients medication error injury
Abbreviations: ADE, adverse drug event MER, medication error rate CPOE, computerized physician order entry CHEO, Childrens Hospital of Eastern Ontario NNT, number needed to treat CI, confidence interval
Medication errors are an internationally recognized source of significant morbidity and mortality in hospitalized patients. In the United States alone, the Institute of Medicine report To Err Is Human: Building a Safer Health System estimated that between 44 000 and 98 000 people die each year from medical errors, whereas in the United Kingdom and Australia adverse events causing patient harm occurred in 10% to 16% of admissions.13 Medication use accounts for at least 20% of adverse events in hospitalized patients.4 Although the majority of medication errors do not result in patient harm, errors that result in a serious adverse drug event (ADE) are associated with increased length of hospital stay, extra costs, and mortality.5
In adults, ADEs occur at a rate of 5 per 100 medication orders.6 A similar error rate has been observed in children who are at risk for unique medication errors such as large, 10-fold errors in dosing.7,8 Children are at risk for medication errors attributable to weight-based dosing, off-label drug usage and preparation, limited reserve to withstand a dosing error, and limited ability to communicate with health care personnel to prevent an error or signal that an error has occurred.9,10 A review of prospective studies of ADEs in hospitalized children noted an overall incidence of 9.5%, with severe reactions accounting for 12% of the total.11 In 2 academic pediatric hospitals, the medication error rate (MER) was 6 per 100 medication orders, the majority of which occurred during physician medication ordering.7 Many ADEs are preventable (51% to 93%), as medication errors often occur during drug ordering and may be corrected, especially if the error is detected early in the order process.5,6,11,12
The significant MER has focused attention on understanding the causes of ADEs and developing methods to prevent them. Advances in information technology, such as computerized physician order entry (CPOE), hold promise of reducing medication-related errors. CPOE has been given a "medium strength of evidence" rating by the Agency for Healthcare Research and Quality as a safety practice to implement, and the Leapfrog Group is promoting CPOE in hospitals as 1 of 3 changes to improve patient safety in America.13,14 Despite these recommendations, there has been limited evaluation and publication of the impact of CPOE on ADEs in part because of the methodologic difficulties in trial design.15 Studies demonstrating CPOE effectiveness have shown a decrease in the rate of serious medication errors but no effect on ADEs.1619
A reduction in the rate of serious medication errors conferred by CPOE would clearly have significant implications for hospitalized children. We assessed the impact of a commercially available CPOE system on medication errors and ADEs in pediatric inpatients at a tertiary care pediatric hospital.
| METHODS |
|---|
|
|
|---|
Intervention
In March 1996, the CHEO implemented, on 2 medical inpatient units, a commercially available CPOE system developed by Eclipsys. The CPOE system was originally introduced as Carevision and underwent periodic product upgrade and is now commercially available as Sunrise Clinical Manager. Clinical decision support was not provided and the CPOE system interfaced with the laboratory system but not with the pharmacy computer. The intervention group consisted of the 2 medical wards on which CPOE was implemented. The control group consisted of 1 medical and 2 surgical wards that continued to use handwritten orders. Each ward unit is clinically independent with respect to nursing staff. Medical patients on the intervention wards are cared for by a team approach consisting of pediatric generalists and subspecialists with assistance from pediatric residents, interns, and medical students. Approximately 30% of the patients cared for by the medical team are admitted off-service to the nonintervention medical and surgical wards.
Medication Error Definition and Surveillance
A medication error was defined as any event involving medication prescription, dispensing, administration, or monitoring of medications irrespective of outcome. Medication errors at CHEO are reported in a standardized fashion by the adverse event reporting system on all inpatient floors. This is a passive reporting system that was constant throughout the duration of the study. After a medication error is detected, an incident report is completed by the nurse and physician involved. The events of the medication error are documented and the severity of patient harm is rated as none, mild, moderate, or severe. The incident report is sent to the Pharmacy Department. Each report is reviewed by the institution Quality Improvement Committee. The medication errors are then entered into a spreadsheet database (Microsoft Excel 97; Microsoft, Redmond, WA). MERs in both the intervention and control groups were analyzed for the 3 years before (April 1, 1993 to March 31, 1996) and 3 years following (January 1, 1997 to December 31, 1999) the implementation of CPOE (Fig 1). From April 1, 1996 to December 31, 1996, following the introduction of CPOE, medication errors were not assessed to allow for the piloting and training of CPOE and a major software upgrade in November 1996.
|
= 0.64; 95% confidence interval [CI]: 0.45, 0.82). All disagreements were resolved through discussion and consensus. The total number of patient days and discharges during the study period was obtained from the CHEO discharge database. The CHEO uses Med2020 WinRecs abstracting software to collect inpatient information on discharge from the hospital. This database has a minimum dataset with definitions for each data element to ensure data quality and consistency.
Statistical Analysis
We computed the ratios of rates before and after CPOE implementation, per 1000 patient days for medication error, potential ADE, and ADE. CIs for these rate ratios were computed under the assumption that the number of events per 1000 patient days followed a Poisson distribution.20 To evaluate the impact of introducing CPOE, we computed the ratio of the rate ratio for the intervention wards and the rate ratio for the control inpatient wards. To provide a clinical interpretation of the effect of CPOE on medication errors, we calculated an analog of the number needed to treat (NNT), representing the expected number of patient days to prevent 1 additional medication error using CPOE.21 The calculation is as follows: NNT = 1/(B x (1 R)) where R is the ratio of rates of medication errors in the intervention versus the control group, and B is a baseline rate, which we took to be the rate of medication errors in the control group following the introduction of CPOE.22
| RESULTS |
|---|
|
|
|---|
|
|
| DISCUSSION |
|---|
|
|
|---|
Despite recommendations to incorporate CPOE into everyday practice and the potential benefit of CPOE in pediatrics, there has been limited evaluation of its effectiveness. Existing studies in adult populations have been performed with "home-grown" systems and have shown a similar beneficial effect on medication errors without a demonstrable decrease in actual patient harm.1619 Children are a vulnerable population at risk for medication error from both a physiologic and developmental viewpoint.23 The rate of medication errors and ADEs for pediatric inpatients are comparable to rates in adults with potential ADEs 3 times more common in children.7 Thus, as a group, children are at risk for ADE with a need to reduce this risk at least as great as in adults. To place in context the observed decrease in medication errors, at our pediatric tertiary care hospital with 40 000 patient days per year, we saw 1 less medication error every 490 patient days (95% CI: 382781) and would therefore prevent 82 (95% CI: 51105) medication errors per year. Although we did not demonstrate an actual decrease in patient harm, all medication errors have the potential to harm a patient. Even at a rate of 1 ADE for every 100 medication errors, with longer exposure to CPOE, we would expect to see a reduction in actual patient injury.24
The finding of this study must be interpreted in light of its limitations. We used retrospective cohort study design because a clinical trial in which patients are randomized to receive CPOE would be costly and methodologically difficult to implement.15 Medication error data were collected prospectively and we included reporting of medication errors before CPOE implementation. The similarity of MERs and ADEs before CPOE implementation (MERs per 1000-patient days, 4.48 vs 4.80) are helpful to assure that the populations were similar with respect to medication error. Another limitation is the passive reporting system for medication error at our institution; however, the inpatient wards were unaware of the study and the policy and procedure for medication error reporting were unchanged and occurred in a standardized fashion throughout the study. Finally, although our MER and number of ADEs are low, they are similar to the rate of medication errors reported in the pediatric literature (0.5117.7 per 1000 patient days), especially when we did not include medication errors occurring in the pharmacy, emergency department, or intensive care units.2527
| CONCLUSIONS |
|---|
|
|
|---|
| ACKNOWLEDGMENTS |
|---|
| FOOTNOTES |
|---|
Reprint requests to (W.J.K.) Division of Pediatric Medicine, Childrens Hospital of Eastern Ontario, 401 Smyth Rd, Ottawa, Ontario, Canada K1H 8L1. E-mail: king{at}cheo.on.ca
This work was presented in part at a meeting of the Pediatric Academic Society; May 2002; Baltimore, MD.
| REFERENCES |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
R. Kaushal, D. W. Bates, E. L. Abramson, J. R. Soukup, and D. A. Goldmann Unit-based clinical pharmacists' prevention of serious medication errors in pediatric inpatients Am. J. Health Syst. Pharm., July 1, 2008; 65(13): 1254 - 1260. [Abstract] [Full Text] [PDF] |
||||
![]() |
K. E. Walsh, C. P. Landrigan, W. G. Adams, R. J. Vinci, J. B. Chessare, M. R. Cooper, P. M. Hebert, E. G. Schainker, T. J. McLaughlin, and H. Bauchner Effect of Computer Order Entry on Prevention of Serious Medication Errors in Hospitalized Children Pediatrics, March 1, 2008; 121(3): e421 - e427. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. A. Taylor, L. A. Loan, J. Kamara, S. Blackburn, and D. Whitney Medication Administration Variances Before and After Implementation of Computerized Physician Order Entry in a Neonatal Intensive Care Unit Pediatrics, January 1, 2008; 121(1): 123 - 128. [Abstract] [Full Text] [PDF] |
||||
![]() |
B. Pate Medical Errors Negatively Impact Physicians' Mental Health and Job Satisfaction AAP Grand Rounds, November 1, 2007; 18(5): 52 - 53. [Full Text] [PDF] |
||||
![]() |
F. FitzHenry, J. F. Peterson, M. Arrieta, L. R. Waitman, J. S. Schildcrout, and R. A. Miller Medication Administration Discrepancies Persist Despite Electronic Ordering J. Am. Med. Inform. Assoc., November 1, 2007; 14(6): 756 - 764. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. T. Holdsworth, R. E. Fichtl, D. W. Raisch, A. Hewryk, M. Behta, E. Mendez-Rico, C. L. Wong, J. Cohen, S. Bostwick, and B. M. Greenwald Impact of Computerized Prescriber Order Entry on the Incidence of Adverse Drug Events in Pediatric Inpatients Pediatrics, November 1, 2007; 120(5): 1058 - 1066. [Abstract] [Full Text] [PDF] |
||||
![]() |
C. Estellat, I. Colombet, S. Vautier, J. Huault-Quentel, P. Durieux, and B. Sabatier Impact of pharmacy validation in a computerized physician order entry context Int. J. Qual. Health Care, October 1, 2007; 19(5): 317 - 325. [Abstract] [Full Text] [PDF] |
||||
![]() |
C. C. Inquilla, S. Szeinbach, E. Seoane-Vazquez, and K. H. Kappeler Pharmacists' perceptions of computerized prescriber-order-entry systems Am. J. Health Syst. Pharm., August 1, 2007; 64(15): 1626 - 1632. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. S. Ash, D. F. Sittig, E. G. Poon, K. Guappone, E. Campbell, and R. H. Dykstra The Extent and Importance of Unintended Consequences Related to Computerized Provider Order Entry J. Am. Med. Inform. Assoc., July 1, 2007; 14(4): 415 - 423. [Abstract] [Full Text] [PDF] |
||||
![]() |
C. Stebbing, I. C K Wong, R. Kaushal, and A. Jaffe The role of communication in paediatric drug safety Arch. Dis. Child., May 1, 2007; 92(5): 440 - 445. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. R Miller, K. A Robinson, L. H Lubomski, M. L Rinke, and P. J Pronovost Medication errors in paediatric care: a systematic review of epidemiology and an evaluation of evidence supporting reduction strategy recommendations Qual. Saf. Health Care, April 1, 2007; 16(2): 116 - 126. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. L. Friedman, S. R. Geoghegan, N. M. Sowers, S. Kulkarni, and R. N. Formica Jr Medication Errors in the Outpatient Setting: Classification and Root Cause Analysis Arch Surg, March 1, 2007; 142(3): 278 - 283. [Abstract] [Full Text] [PDF] |
||||
![]() |
C. R. Weir, J. J.R. Nebeker, B. L. Hicken, R. Campo, F. Drews, and B. LeBar A Cognitive Task Analysis of Information Management Strategies in a Computerized Provider Order Entry Environment J. Am. Med. Inform. Assoc., January 1, 2007; 14(1): 65 - 75. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. K. Wang, N. S. Herzog, R. Kaushal, C. Park, C. Mochizuki, and S. R. Weingarten Prevention of Pediatric Medication Errors by Hospital Pharmacists and the Potential Benefit of Computerized Physician Order Entry Pediatrics, January 1, 2007; 119(1): e77 - e85. [Abstract] [Full Text] [PDF] |
||||
![]() |
C. R. Weir, B. L. Hicken, H. Rappaport, and J. R. Nebeker Crossing the Quality Chasm: The Role of Information Technology Departments. American Journal of Medical Quality, November 1, 2006; 21(6): 382 - 393. [Abstract] [PDF] |
||||
![]() |
K. E. Walsh, W. G. Adams, H. Bauchner, R. J. Vinci, J. B. Chessare, M. R. Cooper, P. M. Hebert, E. G. Schainker, and C. P. Landrigan Medication Errors Related to Computerized Order Entry for Children Pediatrics, November 1, 2006; 118(5): 1872 - 1879. [Abstract] [Full Text] [PDF] |
||||
![]() |
P. A. Abboud, R. Ancheta, M. McKibben, B. R. Jacobs, and Clinical Informatics Outcomes Research Group Impact of workflow-integrated corollary orders on aminoglycoside monitoring in children. Health Informatics Journal, September 1, 2006; 12(3): 187 - 198. [Abstract] [PDF] |
||||
![]() |
E. M. Campbell, D. F. Sittig, J. S. Ash, K. P. Guappone, and R. H. Dykstra Types of Unintended Consequences Related to Computerized Provider Order Entry J. Am. Med. Inform. Assoc., September 1, 2006; 13(5): 547 - 556. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. Le, T. Nguyen, A. V. Law, and J. Hodding Adverse Drug Reactions Among Children Over a 10-Year Period Pediatrics, August 1, 2006; 118(2): 555 - 562. [Abstract] [Full Text] [PDF] |
||||
![]() |
D L Kunac, D M Reith, J Kennedy, N C Austin, and S M Williams Inter- and intra-rater reliability for classification of medication related events in paediatric inpatients. Qual. Saf. Health Care, June 1, 2006; 15(3): 196 - 201. [Abstract] [Full Text] [PDF] |
||||
![]() |
E. Kozer, D. Scolnik, A. MacPherson, D. Rauchwerger, and G. Koren Using a Preprinted Order Sheet to Reduce Prescription Errors in a Pediatric Emergency Department: A Randomized, Controlled Trial Pediatrics, December 1, 2005; 116(6): 1299 - 1302. [Abstract] [Full Text] [PDF] |
||||
![]() |
Y. Y. Han, J. A. Carcillo, S. T. Venkataraman, R. S.B. Clark, R. S. Watson, T. C. Nguyen, H. Bayir, and R. A. Orr Unexpected Increased Mortality After Implementation of a Commercially Sold Computerized Physician Order Entry System Pediatrics, December 1, 2005; 116(6): 1506 - 1512. [Abstract] [Full Text] [PDF] |
||||
![]() |
K E Walsh, R Kaushal, and J B Chessare How to avoid paediatric medication errors: a user's guide to the literature Arch. Dis. Child., July 1, 2005; 90(7): 698 - 702. [Abstract] [Full Text] [PDF] |
||||
![]() |
E. Kozer, W. Seto, Z. Verjee, C. Parshuram, S. Khattak, G. Koren, and D A. Jarvis Prospective observational study on the incidence of medication errors during simulated resuscitation in a paediatric emergency department BMJ, December 4, 2004; 329(7478): 1321. [Abstract] [Full Text] [PDF] |
||||
![]() |
J H Simpson, R Lynch, J Grant, and L Alroomi Reducing medication errors in the neonatal intensive care unit Arch. Dis. Child. Fetal Neonatal Ed., November 1, 2004; 89(6): F480 - F482. [Abstract] [Full Text] [PDF] |
||||
![]() |
P. J. Chung and M. A. Schuster Access And Quality In Child Health Services: Voltage Drops Health Aff., September 1, 2004; 23(5): 77 - 87. [Abstract] [Full Text] [PDF] |
||||
![]() |
B. Bogucki, B. R. Jacobs, J. Hingle, and the Clinical Informatics Outcomes Research Group Computerized Reminders Reduce the Use of Medications during Shortages J. Am. Med. Inform. Assoc., July 1, 2004; 11(4): 278 - 280. [Abstract] [Full Text] [PDF] |
||||
![]() |
P. A. Clark Medication Errors in Family Practice, in Hospitals and After Discharge from the Hospital An Ethical Analysis J. Law Med. Ethics, June 1, 2004; 32(2): 349 - 357. [PDF] |
||||
![]() |
R. G. Berger and J.P. Kichak Computerized Physician Order Entry: Helpful or Harmful? J. Am. Med. Inform. Assoc., March 1, 2004; 11(2): 100 - 103. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||