Published online October 2, 2006
PEDIATRICS Vol. 118 No. 4 October 2006, pp. 1380-1387 (doi:10.1542/peds.2006-0326)
This Article
Right arrow Full Text
Right arrow Full Text (PDF)
Right arrow P3Rs: Submit a response
Right arrow Alert me when this article is cited
Right arrow Alert me when P3Rs are posted
Right arrow Alert me if a correction is posted
Services
Right arrow E-mail this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Add to My File Cabinet
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via CrossRef
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Feldman, M. J.
Right arrow Articles by O'Rourke, E. J.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Feldman, M. J.
Right arrow Articles by O'Rourke, E. J.
Related Collections
Right arrow Office Practice

ARTICLE

Evaluation of the Clinical Assessment Project: A Computer-Based Multimedia Tool to Assess Problem-Solving Ability in Medical Students

Mitchell J. Feldman, MDa,b,c, G. Octo Barnett, MDc, David A. Link, MDa,d, Margaret A. Colemana,d, Janice A. Lowe, MDa,b and Edward J. O'Rourke, MDa,e

a Department of Pediatrics, Harvard Medical School, Boston, Massachusetts
b Department of Pediatrics
c Laboratory of Computer Science, Massachusetts General Hospital, Boston, Massachusetts
d Department of Pediatrics, Cambridge Hospital and Mount Auburn Hospital, Cambridge, Massachusetts
e Department of Pediatrics, Children's Hospital, Boston, Massachusetts

OBJECTIVE. The purpose of this work was to describe Clinical Assessment, a computer-based multimedia patient simulation used to assess the problem-solving abilities of medical students and to evaluate its capacity to guide the assignment of course grade.

METHODS. This was a multisite reviewer-blinded comparison of course grades, National Board of Medical Examiners pediatric examination score, and Clinical Assessment scores at 3 pediatric clerkship sites of the Harvard Medical School. Participants included 470 students completing their pediatric clerkships. Each student's performance on ≤4 Clinical Assessment patient case simulations was compared with National Board of Medical Examiners pediatric examination scores and course grades assigned by clerkship directors based on overall ward performance.

RESULTS. Data from both the National Board of Medical Examiners pediatric "shelf" examination and the course grade were available for 411 students who completed ≥1 Clinical Assessment case. There was a strong correlation between Clinical Assessment score and course grade when comparing students receiving honors versus satisfactory category course grades. Students who ordered more expensive or greater numbers of laboratory tests did not achieve greater diagnostic accuracy on Clinical Assessment. Clinical Assessment had a high positive predictive value for course grade: 95% of students scoring ≥90% on Clinical Assessment achieved an honors category course grade.

CONCLUSIONS. Because nearly all of the students who scored very well on Clinical Assessment received honors category course grades, future high scorers on this examination merit consideration for assigning a high course grade. A computer-based multimedia patient simulation assessment tool provides objective information that can complement a student's National Board of Medical Examiners score and course grade and may assist in evaluating clinical problem-solving ability.

Key Words: pediatrics • multimedia • educational measurement • medical students • computers

Abbreviations: CA—Clinical Assessment • PE—physical examination • PPV—positive predictive value • HMS—Harvard Medical School • NBME—National Board of Medical Examiners

Accepted Jun 1, 2006.