PEDIATRICS Vol. 97 No. 2 February 1996, pp. 179-184
This Article
Right arrow Full Text (PDF)
Right arrow P3Rs: Submit a response
Right arrow Alert me when this article is cited
Right arrow Alert me when P3Rs are posted
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow E-mail this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Add to My File Cabinet
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via CrossRef
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Joorabchi, B.
Right arrow Articles by Devries, J. M.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Joorabchi, B.
Right arrow Articles by Devries, J. M.

Evaluation of Clinical Competence: The Gap Between Expectation and Performance

Bahman Joorabchi MD, MEd1 and Jeffrey M. Devries MD, MPH1

1 The Departments of Pediatrics, Henry Ford Health System, Detroit, and St. Joseph Mercy Hospital, Pontiac, MI.

Objective. To evaluate a 3-year experience with the Objective Structured Clinical Examinations (OSCEs) and to compare faculty expectations with resident performance.

Design. Descriptive analysis of measures of resident performance.

Setting. Community-based pediatric residency program in Michigan.

Participants. One hundred twenty-six pediatric residents at all levels of training.

Methods. The three examinations consisted of 36 to 42 5-minute stations, testing skills in physical examination, history, counseling, telephone management, and test interpretation. A committee of faculty and chief residents predetermined minimum pass levels for each resident level. Results were compared with other indices of resident performance.

Results. There was evidence for content, construct, and concurrent validity, as well as a high degree of reliability. However, 40% to 96% of residents scored below the minimum pass levels for their levels. In each examination, third-year residents had the highest failure rates, yet they scored well on the American Board of Pediatrics in-training examination and on their monthly clinical evaluations. Furthermore, for residents at all levels, the scores reflecting application of data were significantly lower than those assessing data gathering.

Conclusions. The gaps between expectations and performance, and between data gathering and application, have important implications for institutional educational philosophy, suggesting a shift toward more clinically oriented and learner-directed strategies in the design of instructional and evaluation methods.

Key Words: evaluation of clinical competence • criterion-referenced evaluation

Submitted on November 7, 1994
Accepted on March 21, 1995




This article has been cited by other articles:


Home page
 CLIN PEDIATRHome page
C. D. Boreman, M. C. Thomasgard, S. A. Fernandez, and D. L. Coury
Resident Training in Developmental/Behavioral Pediatrics: Where Do We Stand?
Clinical Pediatrics, March 1, 2007; 46(2): 135 - 145.
[Abstract] [PDF]

Home page
 Arch. Dis. Child.Home page
T-C Tsai
Using children as standardised patients for assessing clinical competence in paediatrics
Arch. Dis. Child., December 1, 2004; 89(12): 1117 - 1120.
[Abstract] [Full Text] [PDF]

Home page
 CLIN PEDIATRHome page
A. Kumar, R. Gera, G. Shah, S. Godambe, and D. J. Kallen
Student Evaluation Practices in Pediatric Clerkships: A Survey of the Medical Schools in the United States and Canada
Clinical Pediatrics, October 1, 2004; 43(8): 729 - 735.
[Abstract] [PDF]

Home page
 PediatricsHome page
T. C. Sectish, E. L. Zalneraitis, C. Carraccio, and R. E. Behrman
The State of Pediatrics Residency Training: A Period of Transformation of Graduate Medical Education
Pediatrics, September 1, 2004; 114(3): 832 - 841.
[Abstract] [Full Text] [PDF]

Home page
 Arch DermatolHome page
E. Stratman and J. Dyer
Problem-Based Learning: An Approach to Dermatology Resident Education
Arch Dermatol, October 1, 2002; 138(10): 1299 - 1302.
[Full Text] [PDF]

Home page
 Simulation GamingHome page
J. L. Lane, S. Slavin, and A. Ziv
Simulation in Medical Education: A Review
Simulation Gaming, September 1, 2001; 32(3): 297 - 314.
[Abstract] [PDF]

Home page
 Arch Pediatr Adolesc MedHome page
C. Carraccio and R. Englander
The Objective Structured Clinical Examination: A Step in the Direction of Competency-Based Evaluation
Arch Pediatr Adolesc Med, July 1, 2000; 154(7): 736 - 741.
[Abstract] [Full Text] [PDF]

Home page
 PediatricsHome page
B. S. Siegel and L. W. Greenberg
Effective Evaluation of Residency Education: How Do We Know It When We See It?
Pediatrics, April 1, 2000; 105(4): 964 - 965.
[Full Text]

Home page
 Arch Pediatr Adolesc MedHome page
J. L. Lane, A. Ziv, and J. R. Boulet
A Pediatric Clinical Skills Assessment Using Children as Standardized Patients
Arch Pediatr Adolesc Med, June 1, 1999; 153(6): 637 - 644.
[Abstract] [Full Text] [PDF]

Home page
 CLIN PEDIATRHome page
W. L. Ector, M. A. Campbell, and P. M. Darden
Recent Changes in Residency Requirements for Pediatrics: Who Agrees?
Clinical Pediatrics, October 1, 1998; 37(10): 625 - 630.
[Abstract] [PDF]

Home page
 PediatricsHome page
J. M. Devries, J. E. Berkelhamer, R. A. Molteni, K. S. Edwards, E. K. Kachur;, S. Muret-Wagstaff;, and D. Kittredge
Developing Models for Pediatric Residency Training in Managed Care Settings
Pediatrics, April 1, 1998; 101(4): 753 - 761.
[Abstract] [Full Text] [PDF]

Home page
 Arch Pediatr Adolesc MedHome page
R. I. Hilliard and S. E. Tallett
The Use of an Objective Structured Clinical Examination With Postgraduate Residents in Pediatrics
Arch Pediatr Adolesc Med, January 1, 1998; 152(1): 74 - 78.
[Abstract] [Full Text] [PDF]