The development, validity and reliability of a multimodality objective structured clinical examination in psychiatry
- 1 March 2005
- journal article
- Published by Wiley in Medical Education
- Vol. 39 (3), 292-298
- https://doi.org/10.1111/j.1365-2929.2005.02091.x
Abstract
To evaluate the development, validity and reliability of a multimodality objective structured clinical examination (OSCE) in undergraduate psychiatry, integrating interactive face-to-face and telephone history taking and communication skills stations, videotape mental state examinations and problem-oriented written stations. The development of the OSCE on a restricted budget is described. This study evaluates the validity and reliability of 4 15-18-station OSCEs for 128 students over 1 year. Face and content validity were assessed by a panel of clinicians and from feedback from OSCE participants. Correlations with consultant clinical 'firm grades' were performed. Interrater reliability and internal consistency (interstation reliability) were assessed using generalisability theory. The OSCE was feasible to conduct and had a high level of high perceived face and content validity. Consultant firm grades correlated moderately with scores on interactive stations and poorly with written and video stations. Overall reliability was moderate to good, with G-coefficients in the range 0.55-0.68 for the 4 OSCEs. Integrating a range of modalities into an OSCE in psychiatry appears to represent a feasible, generally valid and reliable method of examination on a restricted budget. Different types of stations appear to have different advantages and disadvantages, supporting the integration of both interactive and written components into the OSCE format.This publication has 13 references indexed in Scilit:
- Should We Use Standardized Patients Instead of Real Patients for High-Stakes Exams in Psychiatry?Academic Psychiatry, 2002
- Creating, Monitoring, and Improving a Psychiatry OSCE: A Guide for FacultyAcademic Psychiatry, 2002
- The effect on reliability of adding a separate written assessment component to an objective structured clinical examinationMedical Education, 2000
- Evaluating Psychiatric Clinical Clerks With a Mini-Objective Structured Clinical ExaminationAcademic Psychiatry, 1997
- An objective structured clinical examination for evaluating psychiatric clinical clerksAcademic Medicine, 1997
- Implementing the OSCE in NottinghamPsychiatric Bulletin, 1997
- Using the Objective Structured Clinical Examination in a Psychiatry ResidencyAcademic Psychiatry, 1993
- Implementing the objective structured clinical examination in a traditional medical schoolAcademic Medicine, 1991
- Assessment of clinical skills with standardized patients: State of the artTeaching and Learning in Medicine, 1990
- Psychometric characteristics of the objective structured clinical examinationMedical Education, 1988