From the Elmwood Pediatric Group, University of Rochester Medical Center, Rochester, New York
| ABSTRACT |
|---|
|
|
|---|
Methods. A total of 383 pediatric residents from various programs in the United States viewed 9 different video-recorded pneumatic otoscopic examinations of tympanic membranes during a continuing medical education course. The ability to differentiate AOM, OME, and normal was ascertained. A mannequin of a child was used to assess technical proficiency of performing tympanocentesis on artificial tympanic membranes. A series of questions was posed regarding appropriate, pathogen-directed, second-line antibiotic selection for AOM.
Results. The average ± standard deviation correct diagnosis on the otoscopic video examination was 41% ± 16% (range: 19%70%; median: 38%) by pediatric residents, tympanocentesis was optimally performed by 89%, and appropriate antibiotic therapy for drug-resistant Streptococcus pneumoniae was selected by 78% and appropriate therapy for ß-lactamase-producing Haemophilus influenzae was selected by 74%.
Conclusions. According to this video-based examination, pediatric residents misdiagnose OME frequently. Pediatric residents have the skills to be trained to perform tympanocentesis. Approximately 75% of pediatric residents have knowledge of the appropriate antibiotics to select for treatment of resistant AOM pathogens. Interactive instruction with simulation technology may enhance skills and lead to improved diagnostic accuracy and treatment paradigms.
Key Words: otitis media antibiotics medical education tympanocentesis
Abbreviations: OM, otitis media AOM, acute otitis media OME, otitis media with effusion CME, continuing medical education CDC, Centers for Disease Control and Prevention TM, tympanic membrane SD, standard deviation CI, confidence interval
| INTRODUCTION |
|---|
|
|
|---|
Most often pediatric residents learn how to diagnose and treat OM on a case-by-case basis.2 Usually this occurs without double-headed otoscopes or otomicroscopes to allow the instructor to ascertain whether the trainee recognizes the features of the otoscopic examination being taught. Furthermore, in a recent study of OM diagnostic accuracy, it was found that practicing pediatricians (the teachers of most pediatric residents) may not know themselves the differentiating features of AOM and OME, because their misdiagnosis frequency may be approximately 50%.9 In other words, the teachers may be passing on inaccurate information during the education process.
A continuing medical education (CME) workshop program was launched in January 1999 and conducted in >200 locations across the United States from 1999 through 2001. A total of 383 pediatric residents attended the workshops, along with 2190 academic- and community-based practicing pediatricians. They were shown video footage of otoendoscopic examinations that were either normal or from patients with AOM or OME. Their skills in performing tympanocentesisas advocated by the Centers for Disease Control and Preventions (CDCs) Drug-Resistant Streptococcus pneumoniae Therapeutic Working Group,10 the American Academy of Pediatrics,11 and several recognized authorities1215was assessed using a simulation mannequin model. In addition, their knowledge about appropriate antibiotic selection for AOM based on guidelines and recommendations10,11 for treatment of drug-resistant S pnemoniae and Haemophilus influenzae was tested.
| METHODS |
|---|
|
|
|---|
Description of Diagnostic Session
Knowledge of the distinguishing features of AOM and OME were assessed by examination based on video footage obtained with an otoendoscope. For familiarizing the pediatric residents with the expectations of the examination, 2 examples were shown: 1) a typical normal tympanic membrane (TM; translucent, slightly gray, fully mobile on pneumatic otoscopy, and with no evidence of middle ear effusion) and 2) a typical TM from a patient with AOM (bulging, red, opaque, and diminished mobility to pneumatic otoscopy with a middle ear effusion). Then, 9 sequential 30-second video clips of otoscopic examinations were shown: in still frame (approximately 10 seconds), then with pneumatic otoscopy (10 seconds), and then again still frame (10 seconds). Each video was projected onto a large screen in a classroom-style setting. All cerumen had been removed from the external auditory canal before filming. The pediatric residents were instructed to record the findings in a structured format and then reach a conclusion as to 1 of 4 possible diagnoses: AOM, OME, retracted TM but otherwise normal without effusion, and normal. The correct diagnosis had been established by consensus among an expert panel based on reviewing the video plus tympanometry and tympanocentesis findings. The video clip had usual and ordinary findings consistent with each diagnosis. As much time as necessary was afforded for each participant in the courses to reach a conclusion and record the answer. Different faculty taught the workshops (see Appendix) but the presentations were standardized; the material was scripted to minimize potential differences in emphasis or information. There was teaching during the video session so that participants understanding about the criteria to differentiate the diagnoses had the potential to improve as the workshop proceeded.
Description of the Tympanocentesis Session
A mannequin model was developed. The mannequin consisted of a plastic external shell head and shoulders made from a mold with an external pinnae and auditory canal. The caliber, length, and angulation of the external auditory canal were designed to the anatomic specifications simulating a 1- to 2-year-old child. The ear canal material was slightly spongy, flesh-colored, and moderately resistant to needle puncture. A cartridge consisting of 4 simulated TMs was inserted into the head portion of the mannequin. A sliding mechanism produced positioning of the artificial TM at an angulation that was anatomically correct. The TM was engineered to simulate the appearance and feel of a pop when a tympanocentesis needle is used for penetration. Behind the TM, artificial pus was placed in the inferior portion of the simulated middle ear space. This was recommended as the target for tympanocentesis. The anterior inferior quadrant was suggested as the preferred location (out of concern for safety and the provision of increased depth before the posterial wall of the middle ear space would be encountered during the aspiration procedure). The superior half of the simulated middle ear space contained a red dye. This was an area of designated avoidance out of concern for possible injury to the malleus, incus, or stapes. At a depth of approximately 5 mm, a second membrane was present, which prevented access to a second chamber that contained a blue dye. The depth between the TM surface and the second chamber was anatomically correlated with the depth of the middle ear space in a 1- to 2-year-old child. Thus, the pediatric resident was instructed to insert the tympanocentesis needle into the inferior half of the simulated TM with preference to the anterior inferior quadrant and advised to avoid the superior half of the TM completely. Last, the pediatric resident was advised that if the tympanocentesis needle was advanced too far, then a blue dye would indicate that event. Instruction was provided on hand positioning during the procedure. An operating head on a hand-held otoscope was used. For this simulation, a 20-gauge, 3.5-inch-long spinal needle was attached to either a 1- or 3-mL syringe. The needle was bent approximately one third from the hub at 45° to 90° to allow advancement of the needle via the exterior auditory canal to the TM without blockage of visualization through the operating scope magnifying lens. Each TM cartridge contained 4 artificial TM/middle ear effusion discs to allow 4 attempts during the training session. Each pediatric resident was allowed up to 15 minutes to complete the 4 tympanocentesis procedures; they were evaluated on the basis of their success with each of the 4 test discs. There were times when the mannequins did not function optimally or time constraints did not allow 4 attempts; these results were included when at least 2 attempts occurred. The grading tool did not include assessment of change in skill during the tympanocentesis attempts.
Antibiotic Management Session
A Powerpoint presentation emphasized the CDCs Drug-Resistant Streptococcus pneumoniae Working Group guideline as an appropriate treatment paradigm10 with a broadened acceptance of several additional antibiotics as among the acceptable second-line choices for persistent and recurrent AOM. Pharmacokinetic/pharmacodynamic prescribing principles and results of double tympanocentesis trial results were explained and described, respectively. Compliance features as an integral component of antibiotic selection were discussed.
Pre- and Post-Test Course Testing
At the beginning and end of the program, pediatric residents were asked questions relevant to the most reliable, predictive TM findings for AOM, the indications for tympanocentesis (ear tap), and appropriate antibiotics for treatment of AOM caused by drug-resistant S pneumoniae and ß-lactamaseproducing H influenzae. At the end of the course, pediatric residents were asked about the effectiveness of the AOM diagnosis interactive video, tympanocentesis mannequin lab, and antibiotic lecture and whether they would change the way they diagnosed AOM, OME, and normal ears and whether they intended to begin performing tympanocentesis.
Statistics
For comparing the pediatric residents performance with that of practicing pediatricians, the comparison of proportions test was used and P
.05 was considered significant.
| RESULTS |
|---|
|
|
|---|
|
|
|
|
|
|
| DISCUSSION |
|---|
|
|
|---|
AOM and OME are disease entities in the OM continuum. There is often a transition between OME and AOM, and the 2 conditions at times may be indistinguishable from each other diagnostically.16 It is sometimes difficult to determine visually whether an effusion in the middle ear space is purulent (consistent with AOM) or nonpurulent (consistent with OME). Misdiagnosis also may occur when a patient who is experiencing a viral upper respiratory infection develops nasopharyngeal and eustachian tube congestion, causing the TM to become distorted (retracted) and thereby misleading the practitioner to conclude that AOM or OME is present.
The course participants did not have the advantage of a specific history of symptoms relating to the physical examination findings displayed in the otoendoscopic videos. However, not all patients with otalgia have AOM. Symptoms that predict AOM are neither sensitive nor specific.17,18 Children with a retracted TM but no effusion may feel discomfort, and those with an upper respiratory tract infection may develop a middle ear effusion (OME) that does not progress to AOM, yet they may display ear tugging and sleeplessness.
The otoendoscopic videos gave a 2-dimensional image, and a better depth of field may have improved diagnostic accuracy. Only 9 test ears were shown; none was normal, and only 1 was AOM. However, before each otoendoscopic examination, the external auditory canal was completely cleared of cerumen, appropriately performed pneumatic otoscopy was included as recommended,19,20 the video was shown for 30 seconds, and as much time as necessary was allowed for participants to reach a conclusion. As a referent group, otolaryngologists who were taking the same video examination generally recognized the correct diagnosis approximately 80% of the time.9 Pediatric residents considered the color of the TM as a key diagnostic sign (based on the precourse responses to most reliable diagnostic criteria for AOM), although it has been shown that the color of the TM does not correlate with pathogen isolation from middle ear effusions.5,20 A red TM with normal TM position and mobility has a predictive value of 7% for AOM.5,20 The position of the TM is key. For both AOM and OME, there is fluid in the middle ear space and TM mobility may be diminished with pneumatic otoscopy examination. Patients with AOM have a TM under positive (full or bulging) pressure, and bacterial pathogens are isolated >90% of the time.21 Patients with OME have a TM under negative pressure (retracted) or no pressure (neutral position), and bacterial pathogens are isolated <10% of the time.21 Only by combining an assessment of TM position, color, and mobility can a 99% predictive value of AOM be achieved when compared with findings at tympanocentesis.5,20
As noted by Steinbach et al,21,22 there is a paucity of formalized resident education regarding otitis media diagnosis and management and no training in tympanocentesis. In a recent study, 27 pediatric residents examined 43 of the same patients (and 86 ears) as a pediatric otolaryngologist and an audiologist using tympanometry. Only a slight to moderate correlation was found between the pediatric residents diagnosis, the otolaryngologists diagnosis, and tympanometry.22 Few other educational programs and evaluations of residents or practitioners in OM diagnosis have been published.2325
In 1999, a report was issued from the Drug-Resistant Streptococcus pneumoniae Therapeutic Working Group convened by the CDC regarding the management of AOM.10 Diagnostic tympanocentesis with culture and susceptibility testing of isolates was recommended. The CDC guideline10 and the American Academy of Pediatrics Red Book11 state that tympanocentesis may be necessary to guide the choice of therapy in difficult AOM cases. Performing a tympanocentesis was thought to be particularly important for children who have received several courses of antimicrobial therapy and therefore are more likely to harbor a multiply-resistant bacteria. Other prominent authorities have advised tympanocentesis for the child who is highly febrile, toxic, in acute pain, immunosuppressed, or experiencing persistent or recurrent AOM.1215 With consideration of an increasing recognized need for the performance of tympanocentesis by properly trained/certified pediatricians, a mannequin has been designed to facilitate training. Pediatric residents demonstrated a high level of skill in performing this procedure on the simulation model. This skill should be added to the program requirements mandated by the Residency Review Committee in Pediatrics.
Antibiotic selection for treatment of AOM is complex.1214 Amoxicillin, in a double dosage at 80 to 100 mg/kg/d, has been recommended in recent guidelines as first-line therapy.10,11 For persistent AOM (clinical failure on therapy or failure within 1 month of completion of a treatment course) and recurrent AOM, antibiotic selection should take into consideration a higher likelihood of drug-resistant S pneumoniae and H influenzae. Guidelines, primarily based on pharmacokinetic and pharmacodynamic antibiotic principles and results of double tympanocentesis trials, have suggested a group of preferred agents and a group of agents with which anticipated efficacy might be lower. When this knowledge was tested during the training workshop, pediatric residents (and pediatricians) chose recommended antibiotics as first and second choices approximately 70% of the time in a pretest and approximately 95% of the time after completion of the course.
A total of 97% of pediatric residents who attended the workshop said that it would change their diagnostic approach to OM, 49% indicated an interest in applying their new skill in tympanocentesis, and approximately 20% showed knowledge acquisition in the area of antibiotic treatment. Ninety percent or more of the pediatric residents found the otoendoscopic video, mannequin lab, and antibiotic lecture to be highly effective learning tools. The active interaction used in the workshops is a more effective teaching format in producing acquisition and retention of knowledge in the education arena compared with standard didactic sessions.26
The long-term outcome was not evaluated among the pediatric residents who attended the workshops. However, after participation in the course, a cohort of pediatricians from 1 community had their medical records monitored for diagnostic codes for AOM, OME, and eustachian tube dysfunction/otalgia compared with a cohort of pediatricians from the same community who did not attend the course.27 The AOM diagnosis code during the 16-month follow-up after CME course participation was used in 70% of OM diagnoses among CME attendees versus 89% among non-CME attendees, whereas the OME diagnosis code was used in 28% and 11%, respectively; this was significant (P = .003).27 A change to more frequent use of guideline-recommended antibiotics also was shown in that follow-up study.
Introduction of a structured, standardized training module in pediatric residency training programs for instructions in the diagnosis and management of OM seems to be needed. An outcomes assessment of such a module would fit well with the call by the Accreditation Council for Graduate Medical Education for competency-based educational outcomes of training.28
| APPENDIX |
|---|
|
|
|---|
| FOOTNOTES |
|---|
Reprint requests to (M.E.P.) Elmwood Pediatric Group, University of Rochester Medical Center, 601 Elmwood Ave, Box 672, Rochester, NY 14642. E-mail: michael_pichichero{at}urmc.rochester.edu
The author is a faculty member of the University of Rochester, the continuing medical education accreditor of the programs described in this paper, and a co-chairman and a principal of Outcomes Management Educational Workshops, the organizer of the programs.
| REFERENCES |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
Y Berkun, R Nir-Paz, A B. Ami, A Klar, E Deutsch, and H Hurvitz Acute otitis media in the first two months of life: characteristics and diagnostic difficulties Arch. Dis. Child., August 1, 2008; 93(8): 690 - 694. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. Keyhani, L. C. Kleinman, M. Rothschild, J. M. Bernstein, R. Anderson, M. Simon, and M. Chassin Clinical Characteristics of New York City Children Who Received Tympanostomy Tubes in 2002 Pediatrics, January 1, 2008; 121(1): e24 - e33. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. M. Chandler, S. M. S. Garcia, and D. P. McCormick Consistency of Diagnostic Criteria for Acute Otitis Media: A Review of the Recent Literature Clinical Pediatrics, March 1, 2007; 46(2): 99 - 108. [Abstract] [PDF] |
||||
![]() |
N. Le Saux, I. Gaboury, M. Baird, T. P. Klassen, J. MacCormick, C. Blanchard, C. Pitters, M. Sampson, and D. Moher A randomized, double-blind, placebo-controlled noninferiority trial of amoxicillin for clinically diagnosed acute otitis media in children 6 months to 5 years of age Can. Med. Assoc. J., February 1, 2005; 172(3): 335 - 341. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. Vayalumkal and J. D. Kellner Tympanocentesis for the Management of Acute Otitis Media in Children: A Survey of Canadian Pediatricians and Family Physicians Arch Pediatr Adolesc Med, October 1, 2004; 158(10): 962 - 965. [Abstract] [Full Text] [PDF] |
||||
![]() |
Subcommittee on Management of Acute Otitis Media Diagnosis and Management of Acute Otitis Media Pediatrics, May 1, 2004; 113(5): 1451 - 1465. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||