Are multiple choice tests fair to medical students with specific learning disabilities?
- 11 September 2009
- journal article
- Published by Springer Science and Business Media LLC in Advances in Health Sciences Education
- Vol. 15 (2), 265-275
- https://doi.org/10.1007/s10459-009-9197-8
Abstract
The purpose of multiple choice tests of medical knowledge is to estimate as accurately as possible a candidate’s level of knowledge. However, concern is sometimes expressed that multiple choice tests may also discriminate in undesirable and irrelevant ways, such as between minority ethnic groups or by sex of candidates. There is little literature to establish whether multiple choice tests may also discriminate against students with specific learning disabilities (SLDs), in particular those with a diagnosis of dyslexia, and whether the commonly-used accommodations allow such students to perform up to their capability. We looked for evidence to help us determine whether multiple choice tests could be relied upon to test all medical students fairly, regardless of disability. We analyzed the mean scores of over 900 undergraduate medical students on eight multiple-choice progress tests containing 1,000 items using a repeated-measures analysis of variance. We included disability, gender and ethnicity as possible explanatory factors, as well as year group. There was no significant difference between mean scores of students with an SLD who had test accommodations and students with no SLD and no test accommodation. Virtually all students were able to complete the tests within the allowed time. There were no significant differences between the mean scores of known minority ethnic groups or between the genders. We conclude that properly-designed multiple-choice tests of medical knowledge do not systematically discriminate against medical students with specific learning disabilities.Keywords
This publication has 18 references indexed in Scilit:
- Assessment of higher order cognitive skills in undergraduate education: modified essay or multiple choice questions? Research paperBMC Medical Education, 2007
- Determining Appropriate Accommodations for Postsecondary Students with Reading and Written Expression DisordersLearning Disabilities Research & Practice, 2007
- Test Accommodations for Students With Disabilities: An Analysis of the Interaction HypothesisReview of Educational Research, 2005
- Effect of ethnicity and gender on performance in undergraduate medical examinationsMedical Education, 2005
- Sources of validity evidence for an internal medicine student evaluation system: an evaluative study of assessment methodsMedical Education, 2005
- Improving the fairness of multiple-choice questions: a literature reviewMedical Teacher, 2004
- Writing Issues in College Students with Learning Disabilities: A Synthesis of the Literature from 1990 to 2000Learning Disability Quarterly, 2003
- Learning disabilities and medical schoolsMedical Education, 2000
- Assessment, Disability and the Problem of CompensationAssessment & Evaluation in Higher Education, 2000
- The assessment of professional competence: Developments, research and practical implicationsAdvances in Health Sciences Education, 1996