Published online December 1, 2005
PEDIATRICS Vol. 116 No. 6 December 2005, pp. 1299-1302 (doi:10.1542/peds.2004-2016)
This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow P3Rs: Submit a response
Right arrow Alert me when this article is cited
Right arrow Alert me when P3Rs are posted
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow E-mail this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in ISI Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Add to My File Cabinet
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via CrossRef
Right arrow Citing Articles via ISI Web of Science (5)
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Kozer, E.
Right arrow Articles by Koren, G.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Kozer, E.
Right arrow Articles by Koren, G.
Related Collections
Right arrow Office Practice

Using a Preprinted Order Sheet to Reduce Prescription Errors in a Pediatric Emergency Department: A Randomized, Controlled Trial

Eran Kozer, MD*,{ddagger},§, Dennis Scolnik, MB, ChB, DCH*,{ddagger}, Alison MacPherson, PhD||, David Rauchwerger, MD* and Gideon Koren, MD{ddagger}

* Emergency Services
{ddagger} Clinical Pharmacology and Toxicology, The Hospital for Sick Children, Department of Pediatrics, University of Toronto, Toronto, Ontario, Canada
§ Pediatric Emergency Services, Assaf Harofeh Medical Center, Zerifin, Israel
|| Institute for Clinical Evaluative Sciences
York University School of Kinesiology and Health Science, Toronto, Ontario, Canada


    ABSTRACT
 TOP
 ABSTRACT
 METHODS
 RESULTS
 DISCUSSION
 REFERENCES
 
Objective. Medication errors are common among pediatric patients and in emergency departments (EDs). Such errors may lead to prolonged hospitalization, unnecessary diagnostic tests and treatments, and death. The objective of this study was to determine whether the use of a structured order sheet reduces the incidence of medication errors in a pediatric ED.

Methods. The study was a randomized, controlled study that was conducted in a tertiary care pediatric hospital. Eighteen days were randomized into 2 study groups: days during which the regular blank order sheets were used and days during which preprinted, formatted, order sheets were used. All patients’ charts from these days were reviewed by 2 medical students, who extracted demographic, clinical, and therapeutic data into a database. Two pediatric emergency physicians, blinded to the form used, reviewed the database and independently decided whether an error had occurred and the severity of the error.

Results. Within the study period, there were 2157 visits to the ED. A total of 2058 (95.4%) charts were available for review. A total of 411 (52.2%) orders for drugs in the ED were ordered on the regular form, and 376 (47.8%) were given on the new form. Drug errors were identified in 68 (16.6%) orders when the regular form was used and in 37 (9.8%) of the orders on the new form. Using the new form was associated with a significant reduction in the risk for an error (odds ratio: 0.55; 95% confidence interval: 0.34–0.90).

Conclusions. The use of a preprinted structured order form significantly reduces medication errors among pediatric patients in the ED.


Key Words: medication errors • emergency medicine • pediatrics

Abbreviations: ED, emergency department • OR, odds ratio • CI, confidence interval

Medication errors are a common cause for iatrogenic adverse events.1,2 They can lead to severe consequences, including prolonged hospitalization, unnecessary diagnostic tests and treatments, and even death.24

Medication errors are common among pediatric patients and in emergency departments (EDs).57 In a recent study,6 we found that 10% of children who presented to a pediatric ED experienced medication errors. We also found an increased risk for errors when a medication was ordered by a trainee and in patients with severe, compared with mild, disease. A higher risk for medication errors was found among trainees at the beginning compared with the end of the academic year.

For reducing medication errors in hospitals, various interventions have been studied. Examples include Computerized Physician Order Entry systems810; having a clinical pharmacist review orders11; the use of a unit dose system12; using preprinted order forms13; easy access to information on prescribing, such as a handheld computer14; and holding educational sessions for the staff.15 Of these, only educational interventions have been studied in the context of the ED, showing that medical trainees scored higher on a written test when they attended an educational tutorial on writing orders.16 The use of a structured order form for medications has not been studied in the ED. The objective of this study was to assess the impact of a structured order sheet on the incidence of medication errors in a pediatric ED.


    METHODS
 TOP
 ABSTRACT
 METHODS
 RESULTS
 DISCUSSION
 REFERENCES
 
The study was a randomized, controlled trial that was conducted at the Hospital for Sick Children (Toronto, Ontario, Canada), a tertiary care pediatric facility. The Research Ethics Board of the Hospital approved the study. Eighteen days were selected randomly during July 2001 by a computer-generated random numbers (block randomization) into 2 arms: days on which the regular blank order sheets (regular form) were used and those when the experimental, preprinted order sheets (Fig 1) were used. On the structured, preprinted medication order sheet, the staff were required to specify the dose, weight-adjusted dose, total daily dose, route of administration, and frequency for each medication ordered during the study. Before the study commenced, ED staff were oriented to the new forms during research and staff meetings. After this orientation, a pilot study of 50 preprinted order forms was conducted in the ED so that the investigators could obtain feedback from the staff on the practicality and utilization of the forms. On the basis of the feedback, adjustments were made to the forms before the protocol was initialized. Trainees also attended a short tutorial on the appropriate ordering of drugs before the study commenced.


Figure 1
View larger version (23K):
[in this window]
[in a new window]
 
Fig 1. New medication order form for drugs in the ED.

 
On every study day, we removed all unused order forms in the ED before midnight of the previous day and replaced them with a new set of forms (either new or regular) to be used until 11:59 PM the following day.

All available patient charts were reviewed for medication errors according to a method described previously.6 Briefly, 2 medical students who were at the end of their second year in medical school attended 2 training sessions that included guidelines for extraction of data from charts under the supervision of 1 of the investigators (E.K.). They subsequently entered into a database the data that included information about patients’ demographics, clinical condition, diagnosis, acuity of condition (based on triage category), details on the prescribing physician, the form used, and all medications prescribed and given to the patient. Drugs that were ordered on the discharge instructions, for use at home, were not included. Physicians were categorized according to their level of training as staff or trainees (interns, residents, and fellows).

Two pediatric emergency physicians, blinded to the form used, reviewed the database and independently decided whether there was an error. An error was defined as drug regimen different from the recommended (dose differed from the recommended dose by 20% or more, deviation by 2 hours or more from the recommended interval between doses, and wrong units or route of administration).6 The absence of date and unclear signature were not considered errors.

Drug errors were classified as insignificant/minimal risk, significant, or severe.6 In cases in which the raters did not agree, the case was discussed in an attempt to come to a consensus. When agreement was not reached, a third investigator reassessed the rating of that error and the median rank was used.

The reference for drug dosages was the hospital’s formulary.17 Drug dosages that were different from the hospital’s formulary were not considered an error when recommended by the Compendium of Pharmaceuticals and Specialties,18 the manufacturer, or other medical literature. Because the investigators were blinded to the time of order and because time of orders is frequently omitted in our department, especially for children with single, rapidly treated encounters, the absence of these data was not considered a medication error in the primary analysis. The frequency of missing times was analyzed in univariate analysis.

Statistical Analysis
A database that included all prescriptions that were written during the study period was used to assess the incidence of medication errors. Frequency distributions for all variables comparing the regular form and the new form were calculated, and statistical differences were assessed using a {chi}2 test. Additional, stepwise, multivariable logistic regression analysis was used to compare the 2 forms. In addition to the form used to order the prescription (new vs regular), we included all of the variables that were previously associated with medication errors, including triage category, physician training, and time of visit to the ED. The analysis was conducted by prescription, not by patient. Therefore, the statistical analysis was adjusted for the clustering of patients, because each patient may have had >1 prescription but had the same form, triage category, and time of day.


    RESULTS
 TOP
 ABSTRACT
 METHODS
 RESULTS
 DISCUSSION
 REFERENCES
 
During the study days, there were 2157 visits to the ED. A total of 2058 (95.4%) charts were available for review. A total of 795 medications were ordered. In 8 (1%) cases, there was not sufficient information to determine whether an error occurred. These orders were excluded from analysis.

A consensus between reviewers of whether an error occurred was reached in all but 7 cases. These 7 cases were reviewed by a third pediatrician (G.K.), and the median rank was used. A total of 105 (13.3%) errors were found among 787 orders. One error, a 10-fold higher dose of codeine, was considered severe; 49 were considered significant; and 55 were ranked as insignificant/minimal risk.

Within the study period, 411 orders for drugs in the ED were randomized to be ordered on the regular form and 376 on the new form. The characteristics of these orders are presented in Table 1. Although subjective feedback on the new form included concerns that the form was "too busy," in the majority of cases, it was still completely filled in. The new form was not used in resuscitation situations, in which most orders were given in a verbal manner. There were no significant differences in the patients’ acuity (based on triage category on arrival to the ED) or the time at which the order was given with the regular form compared with the new form. The percentage of orders by a trainee was 57% on the regular form and 40% when the new form was used (P < .001). There was no difference in the error rate between staff physicians and trainees (odds ratio [OR]: 1.02; 95% confidence interval [CI]: 0.62–1.69). Time was omitted from 95 (23.1%) orders on the regular form and 47 (12.5%) orders on the new form (P < .001). Drug errors were identified in 68 (16.6%) orders when the regular form was used and in 37 (9.8%) orders on the new form. There was 1 severe error and 13 significant errors using the new form and 36 significant errors on the regular form. After controlling for clustering of patients and physician level of training, using the new form was associated with a significant reduction in the risk for an error (OR: 0.55; 95% CI: 0.34–0.90). There was an even greater reduction in the risk for a severe or significant error (OR: 0.39; 95% CI: 0.21–0.77). The final regression model included physician level of training and the form used for the prescription.


View this table:
[in this window]
[in a new window]
 
TABLE 1. Characteristics of Medications Ordered in the ED During the Study

 

    DISCUSSION
 TOP
 ABSTRACT
 METHODS
 RESULTS
 DISCUSSION
 REFERENCES
 
This is the first randomized, controlled study to show that a simple intervention—using a preprinted medication order form—reduces the risk for medication errors in the pediatric ED by 2-fold. Furthermore, the new form was associated with a decrease in the risk for more significant errors and a 2-fold decrease in the number of orders in which the time was omitted. Importantly, the physicians who reviewed the orders were blinded to the form used and therefore not influenced by the study hypothesis.

In a previous study,6 we found an increased risk for errors when a medication was ordered by a trainee and in patients with severe, compared with mild, disease. In the current study, there were no differences between groups in the severity of patients’ condition or in the time at which orders were given. However, despite the randomization, more orders on the regular form were noted to be given by trainees. One may argue that the observed reduction in medication errors with the new form could be partially explained by this difference. However, in a multiple logistic regression analysis, the level of training of the prescribing physician did not contribute to the increased risk for error. Equally important, the association between the form used and the rate of errors remained significant after adjustment for other variables.

Several interventions have been shown to be effective in reducing medication errors and increasing patient safety. Using a computerized Physician Order Entry may improve prescribing behaviors and reduce the number of drug errors.9 With such method, reduction of medication errors has been reported in both adults8 and pediatric inpatients.10 Despite this evidence, the use of this technology is still controversial.19 Moreover, the implementation of such systems is expensive, and they are not available in most hospitals. A recent survey20 of hospitals in the United States found that computerized order entry was not available to physicians at 84% of the participating institutions. The use of such systems in the ED may be even more complicated. It has been shown that physicians spend more time writing orders when using these systems.21 So far, no studies have demonstrated that using computerized systems in the ED is beneficial. Because most drugs in the ED are given on an urgent basis, they are kept on the ward stock. In most cases, drugs are prepared and given by the nurses, and it is not clear whether the computerized technology (at least as it is available today) is applicable to the ED setting. Indeed, computerized order entry systems are found in only 18% of EDs with residency programs, and in many institutions, the technology has not been fully implemented even though acquired.22

Other interventions, such as clinical pharmacists’ reviewing orders11 and the use of a unit dose system,12 require resources that are not always available. The use of handheld computers, which, according to physicians’ self-reporting, reduces the number of preventable adverse drug events,14 has not been evaluated in clinical settings.

The present study has several limitations. The design of the study, ie, identifying the errors through chart auditing, may not detect some errors and could not provide confirmation about outcomes of errors. It is also possible that physicians made fewer errors because they knew that they were being studied and the novelty of the form may have made people more careful. Therefore, the long-term effectiveness of changing forms remains unclear. Because during resuscitation most orders are given verbally, we could not assess the effect of the new form in the most severe patients.

Medication errors continue to be a major concern for patients and health care professionals. Improving patients’ safety and reducing iatrogenic injuries therefore are major priorities.23,24 In the present study, we demonstrated that a low-cost intervention, the use of a preprinted structured order form, significantly reduces medication errors among pediatric patients in the ED. We suggest that preprinted structured order forms should be incorporated into pediatric EDs. These recommendations are in agreement with the recommendations of the American Academy of Pediatrics Committee on Drugs and Hospital care,24 which suggest such forms as one of the strategies for reducing medication errors. Additional studies should examine the clinical impact of such intervention.


    ACKNOWLEDGMENTS
 
This work was supported by the Trainee’s Start-up Fund, the Research Institution, The Hospital for Sick Children, and "Jonathan’s Alert," The Hospital for Sick Children (Toronto, Ontario, Canada). Dr Kozer was a recipient of a fellowship grant from the Research Training Center, The Hospital for Sick Children. Dr Koren is a senior scientist of the Canadian Institutes for Health Research. Dr Macpherson is the recipient of a postdoctoral fellowship from the Canadian Institutes for Health Research

We thank Eve Pinchefsky and Trevor Jamieson for help.


    FOOTNOTES
 
Accepted Feb 14, 2005.

Reprint requests to (E.K.) Pediatric Emergency Services, Assaf Harofeh Medical Center, Zerifin 70300, Israel. E-mail: erank{at}asaf.health.gov.il

No conflict of interest declared.


    REFERENCES
 TOP
 ABSTRACT
 METHODS
 RESULTS
 DISCUSSION
 REFERENCES
 

  1. Bates DW, Cullen DJ, Laird N, et al. Incidence of adverse drug events and potential adverse drug events. Implications for prevention. ADE Prevention Study Group. JAMA. 1995;274 :29 –34
  2. Leape LL, Brennan TA, Laird N, et al. The nature of adverse events in hospitalized patients. Results of the Harvard Medical Practice Study II. N Engl J Med. 1991;324 :377 –384[Abstract]
  3. Brennan TA, Leape LL, Laird NM, et al. Incidence of adverse events and negligence in hospitalized patients. Results of the Harvard Medical Practice Study I. N Engl J Med. 1991;324 :370 –376[Abstract]
  4. Buehler JW, Smith LF, Wallace EM, Heath CW Jr, Kusiak R, Herndon JL. Unexplained deaths in a children’s hospital. An epidemiologic assessment. N Engl J Med. 1985;313 :211 –216[Abstract]
  5. Kaushal R, Bates DW, Landrigan C, et al. Medication errors and adverse drug events in pediatric inpatients. JAMA. 2001;285 :2114 –2120[Abstract/Free Full Text]
  6. Kozer E, Scolnik D, Macpherson A, et al. Variables associated with medication errors in pediatric emergency medicine. Pediatrics. 2002;110 :737 –742[Abstract/Free Full Text]
  7. Lesar TS, Lomaestro BM, Pohl H. Medication-prescribing errors in a teaching hospital. A 9-year experience. Arch Intern Med. 1997;157 :1569 –1576[Abstract]
  8. Bates DW, Leape LL, Cullen DJ, et al. Effect of computerized physician order entry and a team intervention on prevention of serious medication errors. JAMA. 1998;280 :1311 –1316[Abstract/Free Full Text]
  9. Kaushal R, Shojania KG, Bates DW. Effects of computerized physician order entry and clinical decision support systems on medication safety: a systematic review. Arch Intern Med. 2003;163 :1409 –1416[Abstract/Free Full Text]
  10. King WJ, Paice N, Rangrej J, Forestell GJ, Swartz R. The effect of computerized physician order entry on medication errors and adverse drug events in pediatric inpatients. Pediatrics. 2003;112 :506 –509[Abstract/Free Full Text]
  11. Folli HL, Poole RL, Benitz WE, Russo JC. Medication error prevention by clinical pharmacists in two children’s hospitals. Pediatrics. 1987;79 :718 –722[Abstract/Free Full Text]
  12. Fontan JE, Maneglier V, Nguyen VX, Loirat C, Brion F. Medication errors in hospitals: computerized unit dose drug dispensing system versus ward stock distribution system. Pharm World Sci. 2003;25 :112 –117[CrossRef][ISI][Medline]
  13. Thorn DB, Sexton MG, Lemay AP, Sarigianis JS, Melita DD, Gustafson NJ. Effect of a cancer chemotherapy prescription form on prescription completeness. Am J Hosp Pharm. 1989;46 :1802 –1806[Abstract]
  14. Rothschild JM, Lee TH, Bae T, Bates DW. Clinician use of a palmtop drug reference guide. J Am Med Inform Assoc. 2002;9 :223 –229[Abstract/Free Full Text]
  15. Shaughnessy AF, D’Amico F. Long-term experience with a program to improve prescription-writing skills. Fam Med. 1994;26 :168 –171[Medline]
  16. Nelson LS, Gordon PE, Simmons MD, Goldberg WL, Howland MA, Hoffman RS. The benefit of houseofficer education on proper medication dose calculation and ordering. Acad Emerg Med. 2000;7 :1311 –1316[ISI][Medline]
  17. The 2000–2001 Formulary of Drugs. 19th ed. Toronto, Ontario, Canada: The Hospital for Sick Children; 2000
  18. Compendium of Pharmaceuticals and Specialties. 35th ed. Ottawa, Ontario, Canada: Canadian Pharmacist Association; 2000
  19. Oren E, Shaffer ER, Guglielmo BJ. Impact of emerging technologies on medication errors and adverse drug events. Am J Health Syst Pharm. 2003;60 :1447 –1458[Abstract/Free Full Text]
  20. Ash JS, Gorman PN, Seshadri V, Hersh WR. Computerized physician order entry in U.S. hospitals: results of a 2002 survey. J Am Med Inform Assoc. 2004;11 :95 –99[Abstract/Free Full Text]
  21. Shu K, Boyle D, Spurr C, et al. Comparison of time spent writing orders on paper with computerized physician order entry. Medinfo. 2001;10 :1207 –1211[Medline]
  22. Pallin D, Lahman M, Baumlin K. Information technology in emergency medicine residency-affiliated emergency departments. Acad Emerg Med. 2003;10 :848 –852[CrossRef][ISI][Medline]
  23. Kohn LT Corrigan JM, Donaldson MS, eds. To Err Is Human: Building a Safer Health System. Washington, DC: National Academy Press; 2000
  24. Stucky ER. American Academy of Pediatrics Committee on Drugs; American Academy of Pediatrics Committee on Hospital Care. Prevention of medication errors in the pediatric inpatient setting. Pediatrics. 2003;112 :431 –436[Abstract/Free Full Text]

PEDIATRICS (ISSN 1098-4275). ©2005 by the American Academy of Pediatrics




This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow P3Rs: Submit a response
Right arrow Alert me when this article is cited
Right arrow Alert me when P3Rs are posted
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow E-mail this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in ISI Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Add to My File Cabinet
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via CrossRef
Right arrow Citing Articles via ISI Web of Science (5)
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Kozer, E.
Right arrow Articles by Koren, G.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Kozer, E.
Right arrow Articles by Koren, G.
Related Collections
Right arrow Office Practice