Reflections on experimental research in medical education
- 22 April 2008
- journal article
- editorial
- Published by Springer Science and Business Media LLC in Advances in Health Sciences Education
- Vol. 15 (3), 455-464
- https://doi.org/10.1007/s10459-008-9117-3
Abstract
As medical education research advances, it is important that education researchers employ rigorous methods for conducting and reporting their investigations. In this article we discuss several important yet oft neglected issues in designing experimental research in education. First, randomization controls for only a subset of possible confounders. Second, the posttest-only design is inherently stronger than the pretest–posttest design, provided the study is randomized and the sample is sufficiently large. Third, demonstrating the superiority of an educational intervention in comparison to no intervention does little to advance the art and science of education. Fourth, comparisons involving multifactorial interventions are hopelessly confounded, have limited application to new settings, and do little to advance our understanding of education. Fifth, single-group pretest–posttest studies are susceptible to numerous validity threats. Finally, educational interventions (including the comparison group) must be described in detail sufficient to allow replication.Keywords
This publication has 28 references indexed in Scilit:
- Description, justification and clarification: a framework for classifying the purposes of research in medical educationMedical Education, 2008
- Questioning Competence: A Discourse Analysis of Attending Physicians’ Use of Questions to Assess Trainee CompetenceAcademic Medicine, 2007
- Moving the Field Forward: Going Beyond Quantitative–Qualitative*Academic Medicine, 2007
- Trends in Study Methods Used in Undergraduate Medical Education Research, 1969-2007Jama-Journal Of The American Medical Association, 2007
- Quality of reporting of experimental studies in medical education: a systematic reviewMedical Education, 2007
- Volunteer bias in medical education research: an empirical study of over three decades of longitudinal dataMedical Education, 2007
- The value of basic science in clinical diagnosis: creating coherence among signs and symptomsMedical Education, 2004
- The role of method in treatment effectiveness research: Evidence from meta-analysis.Psychological Methods, 2001
- Do you know?Medical Teacher, 1999
- How we should measure "change": Or should we?Psychological Bulletin, 1970