Comparative effectiveness of instructional design features in simulation-based education: Systematic review and meta-analysis
Top Cited Papers
Open Access
- 3 September 2012
- journal article
- review article
- Published by Taylor & Francis Ltd in Medical Teacher
- Vol. 35 (1), e867-e898
- https://doi.org/10.3109/0142159x.2012.714886
Abstract
Background: Although technology-enhanced simulation is increasingly used in health professions education, features of effective simulation-based instructional design remain uncertain. Aims: Evaluate the effectiveness of instructional design features through a systematic review of studies comparing different simulation-based interventions. Methods: We systematically searched MEDLINE, EMBASE, CINAHL, ERIC, PsycINFO, Scopus, key journals, and previous review bibliographies through May 2011. We included original research studies that compared one simulation intervention with another and involved health professions learners. Working in duplicate, we evaluated study quality and abstracted information on learners, outcomes, and instructional design features. We pooled results using random effects meta-analysis. Results: From a pool of 10 903 articles we identified 289 eligible studies enrolling 18 971 trainees, including 208 randomized trials. Inconsistency was usually large (I 2 > 50%). For skills outcomes, pooled effect sizes (positive numbers favoring the instructional design feature) were 0.68 for range of difficulty (20 studies; p < 0.001), 0.68 for repetitive practice (7 studies; p = 0.06), 0.66 for distributed practice (6 studies; p = 0.03), 0.65 for interactivity (89 studies; p < 0.001), 0.62 for multiple learning strategies (70 studies; p < 0.001), 0.52 for individualized learning (59 studies; p < 0.001), 0.45 for mastery learning (3 studies; p = 0.57), 0.44 for feedback (80 studies; p < 0.001), 0.34 for longer time (23 studies; p = 0.005), 0.20 for clinical variation (16 studies; p = 0.24), and −0.22 for group training (8 studies; p = 0.09). Conclusions: These results confirm quantitatively the effectiveness of several instructional design features in simulation-based education.This publication has 33 references indexed in Scilit:
- If you teach them, they will learn: why medical education needs comparative effectiveness researchAdvances in Health Sciences Education, 2012
- Does Simulation-Based Medical Education With Deliberate Practice Yield Better Results Than Traditional Clinical Education? A Meta-Analytic Comparative Review of the EvidenceAcademic Medicine, 2011
- Computerized Virtual Patients in Health Professions Education: A Systematic Review and Meta-AnalysisAcademic Medicine, 2010
- Instructional Design Variations in Internet-Based Learning for Health Professions Education: A Systematic Review and Meta-AnalysisAcademic Medicine, 2010
- Virtual patients: a critical literature review and proposed next stepsMedical Education, 2009
- Predictive Validity Evidence for Medical Education Research Study Quality Instrument Scores: Quality of Submissions to JGIM’s Medical Education Special IssueJournal of General Internal Medicine, 2008
- Realist review - a new method of systematic review designed for complex policy interventionsJournal of Health Services Research & Policy, 2005
- Features and uses of high-fidelity medical simulations that lead to effective learning: a BEME systematic reviewMedical Teacher, 2005
- Measuring inconsistency in meta-analysesBMJ, 2003