In-training examinations as predictors of resident clinical performance
- PMID: 2740167
In-training examinations as predictors of resident clinical performance
Abstract
Previous attempts to predict resident clinical performance based solely on measures of cognitive skills have been uniformly unsuccessful. For the past 8 years, a formative residency evaluation system has been used that includes yearly comprehensive oral in-training examinations (OITEs) assessing each resident's performance in the three areas of professional competence: cognitive, psychomotor, and affective. The results of these examinations and scores received on the written in-training examination (WITE) given by the American Board of Pediatrics were compared with faculty ratings received during the subsequent year of residency. No significant correlation was found at any level of training between WITE scores and clinical performance. Analysis based on clinical setting did not improve these results. Oral in-training examination scores, however, were highly correlated with clinical performance ratings. In addition, with oral in-training examination scores, the "problem" interns--those whose clinical performance rating placed them in the lower 10% of interns--were predicted with a high degree of significance, sensitivity, and specificity. Predictions based on WITEs were not significant. Simultaneous evaluation of all three areas of professional competence should be done when predictions of resident performance are attempted. The OITE is a powerful formative evaluation tool, providing valuable learning experiences as residents are objectively assessed while they perform patient-centered tasks that represent critical skills in the practice of medicine. It allows early detection and possible amelioration of future problems in the clinical performance of a resident.
Similar articles
-
Predicting resident clinical performance with in-training examinations.Res Med Educ. 1988;27:182-7. Res Med Educ. 1988. PMID: 3218854
-
Outcome measures for emergency medicine residency graduates: do measures of academic and clinical performance during residency training correlate with American Board of Emergency Medicine test performance?Acad Emerg Med. 2011 Oct;18 Suppl 2:S59-64. doi: 10.1111/j.1553-2712.2011.01116.x. Acad Emerg Med. 2011. PMID: 21999560
-
Resident recruitment: what are good predictors for performance during pediatric residency training?J Med Assoc Thai. 2002 Jun;85 Suppl 1:S302-11. J Med Assoc Thai. 2002. PMID: 12188428
-
The American Society for Clinical Pathology resident in-service examination: does resident performance provide insight into the effectiveness of clinical pathology education?Clin Lab Med. 2007 Jun;27(2):283-91; abstract vi-vii. doi: 10.1016/j.cll.2007.03.005. Clin Lab Med. 2007. PMID: 17556086 Review.
-
Predicting Resident Performance from Preresidency Factors: A Systematic Review and Applicability to Neurosurgical Training.World Neurosurg. 2018 Feb;110:475-484.e10. doi: 10.1016/j.wneu.2017.11.078. Epub 2017 Nov 23. World Neurosurg. 2018. PMID: 29174240 Review.
Cited by
-
Multimodal In-training Examination in an Emergency Medicine Residency Training Program: A Longitudinal Observational Study.Front Med (Lausanne). 2022 Mar 9;9:840721. doi: 10.3389/fmed.2022.840721. eCollection 2022. Front Med (Lausanne). 2022. PMID: 35355591 Free PMC article.
-
ORGANIZATION OF A COMPREHENSIVE ANESTHESIOLOGY ORAL PRACTICE EXAMINATION PROGRAM: Planning, Structure, Startup, Administration, Growth and Evaluation.J Educ Perioper Med. 1999 May 1;1(2):E007. eCollection 1999 May-Aug. J Educ Perioper Med. 1999. PMID: 27390795 Free PMC article.
-
The relationship between faculty performance assessment and results on the in-training examination for residents in an emergency medicine training program.J Grad Med Educ. 2013 Dec;5(4):582-6. doi: 10.4300/JGME-D-12-00240.1. J Grad Med Educ. 2013. PMID: 24455005 Free PMC article.
-
The impact of feedback to medical housestaff on chart documentation and quality of care in the outpatient setting.J Gen Intern Med. 1997 Jun;12(6):352-6. doi: 10.1046/j.1525-1497.1997.00059.x. J Gen Intern Med. 1997. PMID: 9192252 Free PMC article.
Publication types
MeSH terms
Grants and funding
LinkOut - more resources
Medical
Miscellaneous