



* Division of Emergency Services, Toronto, Ontario, Canada
Division of Clinical Pharmacology and Toxicology, Toronto, Ontario, Canada
Pediatric Outcomes Research Team, the Hospital for Sick Children, Department of Pediatrics, University of Toronto, Toronto, Ontario, Canada
| ABSTRACT |
|---|
|
|
|---|
Methods. A retrospective cohort study was conducted of the charts of 1532 children who were treated in the ED of a pediatric tertiary care hospital during 12 randomly selected days from the summer of 2000. Two pediatricians, blinded to other study variables, independently decided whether a medication error occurred and ranked it according to a severity score. Disagreement was resolved by consensus.
Results. Prescribing errors were identified in 10.1% of the charts. The following variables were associated in univariate analysis with an increased proportion of errors: patients seen between 4 AM and 8 AM (odds ratio [OR]: 2.45; 95% confidence interval [CI]: 1.105.50), patients with severe disease (OR: 2.53; 95% CI: 1.185.41), medication ordered by a trainee (OR: 1.48; 95% CI: 1.032.11), and patients seen during weekends (OR: 1.48; 95% CI: 1.042.11). Among trainees, there was a higher rate of errors at the beginning of the academic year (OR: 1.67; 95% CI: 1.062.64). Logistic regression revealed increased risk for errors when a medication was ordered by a trainee (OR: 1.64; 95% CI: 1.062.52) and in seriously ill patients (OR: 1.55; 95% CI: 1.062.26).
Conclusions. In the pediatric ED, trainees are more likely to commit prescribing errors, and the most seriously ill patients are more likely to be subjected to prescribing errors.
Key Words: medication errors pediatrics emergency medicine
Abbreviations: ED, emergency department OR, odds ratio CI, confidence interval
| INTRODUCTION |
|---|
|
|
|---|
Preventable errors are significantly more common in emergency departments (EDs) than in other hospital departments,3,4 and prescribing errors are most common in pediatric and EDs.9,10 Prescribing and administering medications in the ED is particularly complex for several reasons. Medications frequently need to be given urgently; thus, many are kept in ward stock. Auditing of these drug orders by a pharmacist is not current practice at our institution. In addition, patients in the ED are seen only for a short encounter, and in many cases the physician does not have complete information regarding the patients medical and drug history.
The incidence of medication errors in the pediatric ED has not been fully described, and factors associated with such errors have not been elucidated. In 1 retrospective review of medication errors in a pediatric ED, incorrect recording of patients weights, leading to incorrect dosing, was the most frequently reported error.11 That study, based only on voluntary reporting, could not estimate the true incidence of medication errors. The objectives of our study were to estimate the incidence and type of drug errors in a pediatric ED and to identify factors that may be related to an increased risk of medication errors.
| METHODS |
|---|
|
|
|---|
Two medical students served as research assistants. They attended 2 training sessions that included extraction of data from charts under the supervision of 1 of the investigators, before data extraction. They subsequently extracted the data into a database that included information about patients demographics, clinical condition, diagnosis, acuity of condition (based on triage category), the prescribing physician, and all of the medications prescribed and given to the patient. Physicians were categorized according to their level of training as staff or trainees (interns, residents, and fellows). When the drug regimen was different (dose differed from the recommended dose by 20% or more, deviation by 2 hours or more from the recommended interval between doses, wrong units or route of administration) from the recommended regimen, it was flagged as a potential error. Medications ordered and not given and medications given without a written order were also flagged as an error. Delays of 1 hour or less in drug administration, the absence of date, or unclear signature were not considered errors. To establish the accuracy of data collection, a senior investigator reviewed a random sample of 3% of the charts. The entire database was further reviewed by both senior investigators for potential drug interactions and drugs incorrectly prescribed for any specific condition.
Ranking the Errors
Two pediatric emergency physicians who were aware only of age, weight, diagnosis, and drug details but blinded to the other variables (eg, trainee versus staff physician, day of the week) independently ranked the errors. Drug errors were ranked as insignificant/minimal risk, significant, or severe:
Assessment of the potential effect of each error was based on available pharmacological data and clinical judgment of the physicians. The reference for drug dosages was the hospitals formulary.12 However, drug dosages that were different from the hospitals formulary were not considered an error if recommended by the Compendium of Pharmaceuticals and Specialties,13 the manufacturer, or other medical literature. Knowing that the date and time of orders is frequently omitted in our department, especially for children with single, rapidly treated encounters, the absence of these data were not analyzed as an error. It was believed that inclusion of these data would obscure the more important lessons that could be learned from this study.
The independent rankings were compared in 2 forms: 1) whether a medication error occurred and 2) the severity ranking of the error. In cases in which the raters did not agree, the case was discussed in an attempt to come to a consensus. If agreement was not reached, then a third investigator reassessed the rating of that error and the median rank was used.
The errors were also classified by type according to the system described by Lesar et al.14 Briefly, errors were classified as wrong dose, wrong drug, wrong frequency, wrong route, errors related to patient information (medication given to a patient with known allergy to the drug), and others.
Statistical Analysis
The interrater reliability was measured using a
statistic. Descriptive statistics related to the incidence of medication errors were calculated. Logistic regression was used to assess the likelihood of medication error among all patients for whom a medication was prescribed. The independent relationship between each variable and the outcome variable (error vs no error) was examined. Variables found to be significantly associated with drug errors or those that might confound the relationship between other variables and drug errors were included in a multivariate analysis. Multivariable logistic regression was used to identify factors such as the childs age, gender, level of training of the physician, shifts (day, evening, or night), level of activity in the ED (estimated using patient waiting time), and triage category (a proxy measure for severity of illness) that independently influenced the rates of drug errors. In addition, interaction terms were included to test the interaction between level of training and time of day, and level of training and triage category. Variables were retained in the multivariate analysis when they met the significance level of .05 or when they changed the point estimate of another variable by >10%.
| RESULTS |
|---|
|
|
|---|
|
The
for initial agreement between reviewers on whether an error occurred was 0.79, and the
for ranking of the errors was 0.70, indicating a high level of agreement. Figure 1 presents the cohort flowchart and the methodology applied to identify the errors.
|
|
|
|
|
Multivariate Analysis
All variables that were found to have a significant relationship with medication prescribing errors in univariate analysis were included in a stepwise logistic regression. Factors that were found to be associated with an increased risk of medication errors were medication ordered by a trainee as opposed to staff person (OR: 1.64; 95% CI: 1.062.52) and serious compared with least ill patients (OR: 1.55; 95% CI: 1.062.26).
| DISCUSSION |
|---|
|
|
|---|
Previous studies have found that medication errors occur frequently in the intensive care setting,18 perhaps as a result of the complexity and intensity of treatment and the use of unfamiliar medications.19,20 Although many patients who are seen at the ED do not have life-threatening conditions, some of the circumstances found in intensive care units also exist in the pediatric ED, which treats patients with a high acuity of illness and has a rapid turnover of patients. The incidence of medication errors that we found is comparable with the 6.6% to 11.7% incidence reported from pediatric intensive care units.15,21 Our results suggest that seriously ill patients are susceptible to higher rates of medication errors. This may be related in part to increased use of medication in such patients.
Even in a favorable setting, a substantial proportion of pediatric residents make mistakes while calculating drug doses.22,23 It is therefore not surprising that dosing errors were the most common errors made by physicians. These findings are consistent with previous studies identifying dosage calculations as the most frequent reason for medication errors in pediatric patients.14,24
We found a significantly higher rate of errors in the ED between 4 AM and 8 AM compared with 8 AM to 12 PM. Although one may surmise that this is the result of physicians tiredness, after adjusting for other variables, this association was no longer significant, suggesting that the association cannot simply be attributed to physicians tiredness. The higher rate of errors at night might be the result of a lower proportion of staff physicians during night shifts or of less supervision of trainees work at night or because patients who are seen late at night were more seriously ill. Our sample size was not sufficient to test all of these hypotheses; however, they should be considered in future research.
We used the waiting time before being seen by a physician as an indirect measure of the workload in the ED, with waiting time of >2 hours (which occurred in 20% of the patients) as an indicator for increased workload. This factor was not associated with an increased risk of errors. However, an association may not be ruled out on the basis of these data for 2 reasons. First, the study was conducted in the summer, when the workload in pediatric EDs is traditionally lighter. Second, in our study, the most seriously ill patients were seen promptly; thus, the effect of workload, as estimated by waiting time, could not be assessed in these patients.
Our findings suggest that the most important risk factor for errors in the pediatric ED is the physicians level of training. Two previous studies demonstrated that the rate of medication errors in a pediatric service doubled when new physicians started their rotation18 and that first-year residents have higher rates of prescription errors.25 The finding that trainees made more errors at the beginning of the academic year strengthens the plausibility of the association between level of training and the rate of errors. Contrary to these studies and to our findings, another study did not find differences in rates of errors made by attending physicians and residents.26 One explanation for the effect of level of training on the proportion of errors in our study may be related to the setting in which this study was conducted. The Hospital for Sick Children is a tertiary care pediatric hospital, and its ED is the primary training site in pediatrics for University of Toronto medical residents. Approximately 360 trainees at different levels rotate through the ED each year. Only a small proportion of these trainees are pediatric residents. Most of them are in their first year of residency with very limited experience in pediatrics. In contrast, staff physicians are academic pediatricians with specialized training in emergency medicine.
The possibility of system errors as an underlying cause for medication mishaps has to be investigated. Although individuals make mistakes, characteristics of the system in which they are working can make errors more likely to happen and more difficult to detect.27 It has been postulated that the best strategy to reduce drug errors is to improve the system by which drugs are given, thereby making it safer.28 Examples of such approaches are the use of a unit-dose system, which has been shown to reduce significantly medication errors in committed hospital wards,29,30 and the use of a computerized system for prescribing medications.31,32 Including a pharmacist as part of the clinical team and having a satellite pharmacy in the ward were also suggested as measures to reduce medication errors.15,33 These strategies could be adapted to the environment of the ED and then evaluated in clinical trials.
This study has several limitations. The retrospective design limited available data to those documented on the ED chart. This design could not detect many errors in drug administration. Other factors that could influence the medication error rate, such as the interaction among parents, patients, nurses, aides, noise, and concurrent events in the ED, were not analyzed because they were not documented on the chart and could not be measured accurately. Therefore, our analysis focused on prescribing errors. In many cases, we could not determine whether an adverse drug event occurred as a result of the error. ED patients are either admitted to inpatient units or discharged from the hospital from the ED. It was not possible to assess dosing intervals in admitted patients because ward physicians rewrote the orders. For discharged patients, we could not determine whether medications were given as ordered. Therefore, we included all documented errors in our analysis. Similar to other groups,2 we believe that identifying these errors, even ones that were intercepted before harm was done, is important in developing strategies to reduce adverse drug events. An additional limitation of the study is that the only information collected on the prescribing physician was level of training. We therefore could not examine the effect by each physician. However, >80 different physicians worked in the ED on the study days and only a few of them were sampled >3 times. Therefore, it is unlikely that clustering of errors by 1 physician significantly affected the results. The relatively small sample size limited our ability to conduct stratified analyses. For example, we compared staff physicians with trainees but were unable to compare among trainees with different levels of training. It is also important to note that because the study was conducted in a tertiary care pediatric hospital, the results (especially the findings regarding trainees) may not be generalizable to other hospitals.
| CONCLUSION |
|---|
|
|
|---|
| ACKNOWLEDGMENTS |
|---|
| FOOTNOTES |
|---|
Reprint requests to (E.K.) Division of Clinical Pharmacology and Toxicology, the Hospital for Sick Children, 555 University Ave, Toronto, Ontario, Canada M5G 1X8. E-mail: eran.kozer{at}sickkids.on.ca
Presented, in part, at the Annual Meeting of the American Society for Clinical Pharmacology and Therapeutics; March 610, 2001; Orlando, FL; and the Pediatric Academic Societies Meeting, April 28May 1, 2001; Baltimore, MD.
| REFERENCES |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
B. E. Sard, K. E. Walsh, G. Doros, M. Hannon, W. Moschetti, and H. Bauchner Retrospective Evaluation of a Computerized Physician Order Entry Adaptation to Prevent Prescribing Errors in a Pediatric Emergency Department Pediatrics, October 1, 2008; 122(4): 782 - 787. [Abstract] [Full Text] [PDF] |
||||
![]() |
H. S. Yin, B. P. Dreyer, L. van Schaick, G. L. Foltin, C. Dinglas, and A. L. Mendelsohn Randomized Controlled Trial of a Pictogram-Based Intervention to Reduce Liquid Medication Dosing Errors and Improve Adherence Among Caregivers of Young Children Arch Pediatr Adolesc Med, September 1, 2008; 162(9): 814 - 822. [Abstract] [Full Text] [PDF] |
||||
![]() |
G. S. Takata, W. Mason, C. Taketomo, T. Logsdon, and P. J. Sharek Development, Testing, and Findings of a Pediatric-Focused Trigger Tool to Identify Medication-Related Harm in US Children's Hospitals Pediatrics, April 1, 2008; 121(4): e927 - e935. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. R Miller, K. A Robinson, L. H Lubomski, M. L Rinke, and P. J Pronovost Medication errors in paediatric care: a systematic review of epidemiology and an evaluation of evidence supporting reduction strategy recommendations Qual. Saf. Health Care, April 1, 2007; 16(2): 116 - 126. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. H. Kaji, M. Gausche-Hill, H. Conrad, K. D. Young, W. J. Koenig, E. Dorsey, and R. J. Lewis Emergency Medical Services System Changes Reduce Pediatric Epinephrine Dosing Errors in the Prehospital Setting Pediatrics, October 1, 2006; 118(4): 1493 - 1500. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. A. Ghaleb, N. Barber, B. D Franklin, V. W. Yeung, Z. F Khaki, and I. C. Wong Systematic Review of Medication Errors in Pediatric Patients Ann. Pharmacother., October 1, 2006; 40(10): 1766 - 1776. [Abstract] [Full Text] [PDF] |
||||
![]() |
D L Kunac, D M Reith, J Kennedy, N C Austin, and S M Williams Inter- and intra-rater reliability for classification of medication related events in paediatric inpatients. Qual. Saf. Health Care, June 1, 2006; 15(3): 196 - 201. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. A. Ghaleb and I. C. K. Wong Medication errors in paediatric patients Arch. Dis. Child. Ed. Pract., April 1, 2006; 91(1): ep20 - ep20. [Full Text] [PDF] |
||||
![]() |
E. Kozer, D. Scolnik, A. MacPherson, D. Rauchwerger, and G. Koren Using a Preprinted Order Sheet to Reduce Prescription Errors in a Pediatric Emergency Department: A Randomized, Controlled Trial Pediatrics, December 1, 2005; 116(6): 1299 - 1302. [Abstract] [Full Text] [PDF] |
||||
![]() |
M A Ghaleb, N Barber, B Dean Franklin, and I C K Wong What constitutes a prescribing error in paediatrics? Qual. Saf. Health Care, October 1, 2005; 14(5): 352 - 357. [Abstract] [Full Text] [PDF] |
||||
![]() |
K E Walsh, R Kaushal, and J B Chessare How to avoid paediatric medication errors: a user's guide to the literature Arch. Dis. Child., July 1, 2005; 90(7): 698 - 702. [Abstract] [Full Text] [PDF] |
||||
![]() |
E. Kozer, W. Seto, Z. Verjee, C. Parshuram, S. Khattak, G. Koren, and D A. Jarvis Prospective observational study on the incidence of medication errors during simulated resuscitation in a paediatric emergency department BMJ, December 4, 2004; 329(7478): 1321. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. Goldmann and R. Kaushal Time to Tackle the Tough Issues in Patient Safety Pediatrics, October 1, 2002; 110(4): 823 - 826. [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||