,


* Emergency Services
Clinical Pharmacology and Toxicology, The Hospital for Sick Children, Department of Pediatrics, University of Toronto, Toronto, Ontario, Canada
Pediatric Emergency Services, Assaf Harofeh Medical Center, Zerifin, Israel
|| Institute for Clinical Evaluative Sciences
¶ York University School of Kinesiology and Health Science, Toronto, Ontario, Canada
| ABSTRACT |
|---|
|
|
|---|
Methods. The study was a randomized, controlled study that was conducted in a tertiary care pediatric hospital. Eighteen days were randomized into 2 study groups: days during which the regular blank order sheets were used and days during which preprinted, formatted, order sheets were used. All patients charts from these days were reviewed by 2 medical students, who extracted demographic, clinical, and therapeutic data into a database. Two pediatric emergency physicians, blinded to the form used, reviewed the database and independently decided whether an error had occurred and the severity of the error.
Results. Within the study period, there were 2157 visits to the ED. A total of 2058 (95.4%) charts were available for review. A total of 411 (52.2%) orders for drugs in the ED were ordered on the regular form, and 376 (47.8%) were given on the new form. Drug errors were identified in 68 (16.6%) orders when the regular form was used and in 37 (9.8%) of the orders on the new form. Using the new form was associated with a significant reduction in the risk for an error (odds ratio: 0.55; 95% confidence interval: 0.340.90).
Conclusions. The use of a preprinted structured order form significantly reduces medication errors among pediatric patients in the ED.
Key Words: medication errors emergency medicine pediatrics
Abbreviations: ED, emergency department OR, odds ratio CI, confidence interval
Medication errors are a common cause for iatrogenic adverse events.1,2 They can lead to severe consequences, including prolonged hospitalization, unnecessary diagnostic tests and treatments, and even death.24
Medication errors are common among pediatric patients and in emergency departments (EDs).57 In a recent study,6 we found that 10% of children who presented to a pediatric ED experienced medication errors. We also found an increased risk for errors when a medication was ordered by a trainee and in patients with severe, compared with mild, disease. A higher risk for medication errors was found among trainees at the beginning compared with the end of the academic year.
For reducing medication errors in hospitals, various interventions have been studied. Examples include Computerized Physician Order Entry systems810; having a clinical pharmacist review orders11; the use of a unit dose system12; using preprinted order forms13; easy access to information on prescribing, such as a handheld computer14; and holding educational sessions for the staff.15 Of these, only educational interventions have been studied in the context of the ED, showing that medical trainees scored higher on a written test when they attended an educational tutorial on writing orders.16 The use of a structured order form for medications has not been studied in the ED. The objective of this study was to assess the impact of a structured order sheet on the incidence of medication errors in a pediatric ED.
| METHODS |
|---|
|
|
|---|
|
All available patient charts were reviewed for medication errors according to a method described previously.6 Briefly, 2 medical students who were at the end of their second year in medical school attended 2 training sessions that included guidelines for extraction of data from charts under the supervision of 1 of the investigators (E.K.). They subsequently entered into a database the data that included information about patients demographics, clinical condition, diagnosis, acuity of condition (based on triage category), details on the prescribing physician, the form used, and all medications prescribed and given to the patient. Drugs that were ordered on the discharge instructions, for use at home, were not included. Physicians were categorized according to their level of training as staff or trainees (interns, residents, and fellows).
Two pediatric emergency physicians, blinded to the form used, reviewed the database and independently decided whether there was an error. An error was defined as drug regimen different from the recommended (dose differed from the recommended dose by 20% or more, deviation by 2 hours or more from the recommended interval between doses, and wrong units or route of administration).6 The absence of date and unclear signature were not considered errors.
Drug errors were classified as insignificant/minimal risk, significant, or severe.6 In cases in which the raters did not agree, the case was discussed in an attempt to come to a consensus. When agreement was not reached, a third investigator reassessed the rating of that error and the median rank was used.
The reference for drug dosages was the hospitals formulary.17 Drug dosages that were different from the hospitals formulary were not considered an error when recommended by the Compendium of Pharmaceuticals and Specialties,18 the manufacturer, or other medical literature. Because the investigators were blinded to the time of order and because time of orders is frequently omitted in our department, especially for children with single, rapidly treated encounters, the absence of these data was not considered a medication error in the primary analysis. The frequency of missing times was analyzed in univariate analysis.
Statistical Analysis
A database that included all prescriptions that were written during the study period was used to assess the incidence of medication errors. Frequency distributions for all variables comparing the regular form and the new form were calculated, and statistical differences were assessed using a
2 test. Additional, stepwise, multivariable logistic regression analysis was used to compare the 2 forms. In addition to the form used to order the prescription (new vs regular), we included all of the variables that were previously associated with medication errors, including triage category, physician training, and time of visit to the ED. The analysis was conducted by prescription, not by patient. Therefore, the statistical analysis was adjusted for the clustering of patients, because each patient may have had >1 prescription but had the same form, triage category, and time of day.
| RESULTS |
|---|
|
|
|---|
A consensus between reviewers of whether an error occurred was reached in all but 7 cases. These 7 cases were reviewed by a third pediatrician (G.K.), and the median rank was used. A total of 105 (13.3%) errors were found among 787 orders. One error, a 10-fold higher dose of codeine, was considered severe; 49 were considered significant; and 55 were ranked as insignificant/minimal risk.
Within the study period, 411 orders for drugs in the ED were randomized to be ordered on the regular form and 376 on the new form. The characteristics of these orders are presented in Table 1. Although subjective feedback on the new form included concerns that the form was "too busy," in the majority of cases, it was still completely filled in. The new form was not used in resuscitation situations, in which most orders were given in a verbal manner. There were no significant differences in the patients acuity (based on triage category on arrival to the ED) or the time at which the order was given with the regular form compared with the new form. The percentage of orders by a trainee was 57% on the regular form and 40% when the new form was used (P < .001). There was no difference in the error rate between staff physicians and trainees (odds ratio [OR]: 1.02; 95% confidence interval [CI]: 0.621.69). Time was omitted from 95 (23.1%) orders on the regular form and 47 (12.5%) orders on the new form (P < .001). Drug errors were identified in 68 (16.6%) orders when the regular form was used and in 37 (9.8%) orders on the new form. There was 1 severe error and 13 significant errors using the new form and 36 significant errors on the regular form. After controlling for clustering of patients and physician level of training, using the new form was associated with a significant reduction in the risk for an error (OR: 0.55; 95% CI: 0.340.90). There was an even greater reduction in the risk for a severe or significant error (OR: 0.39; 95% CI: 0.210.77). The final regression model included physician level of training and the form used for the prescription.
|
| DISCUSSION |
|---|
|
|
|---|
In a previous study,6 we found an increased risk for errors when a medication was ordered by a trainee and in patients with severe, compared with mild, disease. In the current study, there were no differences between groups in the severity of patients condition or in the time at which orders were given. However, despite the randomization, more orders on the regular form were noted to be given by trainees. One may argue that the observed reduction in medication errors with the new form could be partially explained by this difference. However, in a multiple logistic regression analysis, the level of training of the prescribing physician did not contribute to the increased risk for error. Equally important, the association between the form used and the rate of errors remained significant after adjustment for other variables.
Several interventions have been shown to be effective in reducing medication errors and increasing patient safety. Using a computerized Physician Order Entry may improve prescribing behaviors and reduce the number of drug errors.9 With such method, reduction of medication errors has been reported in both adults8 and pediatric inpatients.10 Despite this evidence, the use of this technology is still controversial.19 Moreover, the implementation of such systems is expensive, and they are not available in most hospitals. A recent survey20 of hospitals in the United States found that computerized order entry was not available to physicians at 84% of the participating institutions. The use of such systems in the ED may be even more complicated. It has been shown that physicians spend more time writing orders when using these systems.21 So far, no studies have demonstrated that using computerized systems in the ED is beneficial. Because most drugs in the ED are given on an urgent basis, they are kept on the ward stock. In most cases, drugs are prepared and given by the nurses, and it is not clear whether the computerized technology (at least as it is available today) is applicable to the ED setting. Indeed, computerized order entry systems are found in only 18% of EDs with residency programs, and in many institutions, the technology has not been fully implemented even though acquired.22
Other interventions, such as clinical pharmacists reviewing orders11 and the use of a unit dose system,12 require resources that are not always available. The use of handheld computers, which, according to physicians self-reporting, reduces the number of preventable adverse drug events,14 has not been evaluated in clinical settings.
The present study has several limitations. The design of the study, ie, identifying the errors through chart auditing, may not detect some errors and could not provide confirmation about outcomes of errors. It is also possible that physicians made fewer errors because they knew that they were being studied and the novelty of the form may have made people more careful. Therefore, the long-term effectiveness of changing forms remains unclear. Because during resuscitation most orders are given verbally, we could not assess the effect of the new form in the most severe patients.
Medication errors continue to be a major concern for patients and health care professionals. Improving patients safety and reducing iatrogenic injuries therefore are major priorities.23,24 In the present study, we demonstrated that a low-cost intervention, the use of a preprinted structured order form, significantly reduces medication errors among pediatric patients in the ED. We suggest that preprinted structured order forms should be incorporated into pediatric EDs. These recommendations are in agreement with the recommendations of the American Academy of Pediatrics Committee on Drugs and Hospital care,24 which suggest such forms as one of the strategies for reducing medication errors. Additional studies should examine the clinical impact of such intervention.
| ACKNOWLEDGMENTS |
|---|
We thank Eve Pinchefsky and Trevor Jamieson for help.
| FOOTNOTES |
|---|
Reprint requests to (E.K.) Pediatric Emergency Services, Assaf Harofeh Medical Center, Zerifin 70300, Israel. E-mail: erank{at}asaf.health.gov.il
No conflict of interest declared.
| REFERENCES |
|---|
|
|
|---|
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||