A Comparison of Physician Examiners and Trained Assessors in a High-Stakes OSCE Setting
- 1 October 2005
- journal article
- research article
- Published by Ovid Technologies (Wolters Kluwer Health) in Academic Medicine
- Vol. 80 (Supplement), S59-S62
- https://doi.org/10.1097/00001888-200510001-00017
Abstract
The Medical Council of Canada (MCC) administers an objective structured clinical examination for licensure. Traditionally, physician examiners (PE) have evaluated these examinees. Recruitment of physicians is becoming more difficult. Determining if alternate scorers can be used is of increasing importance. In 2003, the MCC ran a study using trained assessors (TA) simultaneously with PEs. Four examination centers and three history-taking stations were selected. Health care workers were recruited as the TAs. A 3 × 2 × 4 mixed analyses of variance indicated no significant difference between scorers (F1,462 = .01, p = .94). There were significant interaction effects, which were, localized to site 1/station 3, site 3/station 2, and site 4/station1. Pass/fail decisions would have misclassified 14.4–25.01% of examinees. Trained assessors may be a valid alternative to PE for completing checklists in history-taking stations, but their role in completing global ratings is not supported by this study.Keywords
This publication has 9 references indexed in Scilit:
- Assessment of English proficiency in international medical graduates by physician examiners and standardized patients.Medical Education, 2001
- A Comparison of Physician Examinersʼ, Standardized Patientsʼ, and Communication Expertsʼ Ratings of International Medical Graduatesʼ English ProficiencyAcademic Medicine, 2000
- Assessing the impacts of intra-site and inter-site checklist recording discrepancies on the reliability of scores obtained in a nationally administered standardized patient examinationAcademic Medicine, 1999
- THE CONTINUED STUDY OF STANDARDIZED PATIENTS IN ASSESSMENTAcademic Medicine, 1998
- Using the Judgments of Physician Examiners in Setting the Standards for a National Multi-center High Stakes OSCEAdvances in Health Sciences Education, 1997
- Who should rate candidates in an objective structured clinical examination?Academic Medicine, 1996
- Effects of using two or more standardized patients to simulate the same case on case means and case failure ratesAcademic Medicine, 1991
- Training and experience of examinersMedical Education, 1989
- The selection and training of examiners for clinical examinationsMedical Education, 1980