Systematic review to establish absolute standards for technical performance in surgery
- 30 September 2016
- journal article
- review article
- Published by Oxford University Press (OUP) in British Journal of Surgery
- Vol. 104 (1), 13-21
- https://doi.org/10.1002/bjs.10313
Abstract
Standard setting allows educators to create benchmarks that distinguish between those who pass and those who fail an assessment. It can also be used to create standards in clinical and simulated procedural skill. The objective of this review was to perform a systematic review of the literature using absolute standard-setting methodology to create benchmarks in technical performance. A systematic review was conducted by searching MEDLINE, Embase, PsycINFO and the Cochrane Database of Systematic Reviews. Abstracts of retrieved studies were reviewed and those meeting the inclusion criteria were selected for full-text review. The quality of evidence presented in the included studies was assessed using the Medical Education Research Study Quality Instrument (MERSQI), where a score of 14 or more of 18 indicates high-quality evidence. Of 1809 studies identified, 37 used standard-setting methodology for assessment of procedural skill. Of these, 24 used participant-centred and 13 employed item-centred methods. Thirty studies took place in a simulated environment, and seven in a clinical setting. The included studies assessed residents (26 of 37), fellows (6 of 37) and staff physicians (17 of 37). Seventeen articles achieved a MERSQI score of 14 or more of 18, whereas 20 did not meet this mark. Absolute standard-setting methodologies can be used to establish cut-offs for procedural skill assessments.This publication has 54 references indexed in Scilit:
- Reliable and valid assessment of ultrasound operator competence in obstetrics and gynecologyUltrasound in Obstetrics & Gynecology, 2014
- Simulation-based education with mastery learning improves residents' lumbar puncture skillsNeurology, 2012
- Simulation-Based Education with Mastery Learning Improves Paracentesis SkillsJournal of Graduate Medical Education, 2012
- Training to competency in colonoscopy: assessing and defining competency standardsGastrointestinal Endoscopy, 2011
- Assessing Vaginal Surgical Skills Using Video Motion AnalysisObstetrics & Gynecology, 2009
- Mastery learning of thoracentesis skills by internal medicine residents using simulation technology and deliberate practiceJournal of Hospital Medicine, 2008
- FLS simulator performance predicts intraoperative laparoscopic skillSurgical Endoscopy, 2007
- Is an Angoff Standard an Indication of Minimal Competence of Examinees or of Judges?Advances in Health Sciences Education, 2006
- Evaluating laparoscopic skillsSurgical Endoscopy, 2003