Comparison of Two Standard-setting Methods for Advanced Cardiac Life Support Training
- 1 October 2005
- journal article
- research article
- Published by Ovid Technologies (Wolters Kluwer Health) in Academic Medicine
- Vol. 80 (Supplement), S63-S66
- https://doi.org/10.1097/00001888-200510001-00018
Abstract
This study used the Angoff and Hofstee standard-setting methods to derive minimum passing scores for six advanced cardiac life support (ACLS) procedures. An expert panel provided item-based (Angoff) and group-based (Hofstee) judgments about six ACLS performance checklists on two occasions separated by ten weeks. Interrater reliabilities and test-retest reliability (stability) of the judgments were calculated. Derived ACLS passing standards are compared to historical ACLS performance data from two groups of ACLS-trained internal medicine residents. Both the Angoff and Hofstee standard-setting methods produced reliable and stable data. Hofstee minimum passing scores (MPSs) were uniformly more stringent than Angoff MPSs. Interpretation of historical ACLS performance data from medical residents shows the MPSs derived in this study would yield higher-than-expected failure rates. Systematic standard setting for ACLS procedures is a necessary step toward the creation of mastery learning educational programs.Keywords
This publication has 15 references indexed in Scilit:
- Simulation-Based Training of Internal Medicine Residents in Advanced Cardiac Life Support Protocols: A Randomized TrialTeaching and Learning in Medicine, 2005
- Quality of Cardiopulmonary Resuscitation During Out-of-Hospital Cardiac ArrestJAMA, 2005
- Standard Setting for OSCEs: Trial of Borderline ApproachAdvances in Health Sciences Education, 2004
- SETTING STANDARDS FOR PERFORMANCE ASSESSMENTAcademic Medicine, 1998
- In-Hospital ResuscitationCirculation, 1997
- Standard setting in medical educationAcademic Medicine, 1996
- Validating the Performance Standards Associated With Passing ScoresReview of Educational Research, 1994
- The Reproducibility of Standards Over Groups and OccasionsApplied Measurement in Education, 1992
- A Comparison of Three Variations on a Standard-Setting MethodJournal of Educational Measurement, 1987
- COMPROMISE MODELS FOR ESTABLISHING EXAMINATION STANDARDSJournal of Educational Measurement, 1985