The Feasibility of Sharing Simulation-Based Evaluation Scenarios in Anesthesiology
- 1 October 2005
- journal article
- Published by Ovid Technologies (Wolters Kluwer Health) in Anesthesia & Analgesia
- Vol. 101 (4), 1068-1074
- https://doi.org/10.1213/01.ane.0000168272.10598.51
Abstract
We prospectively assessed the feasibility of international sharing of simulation-based evaluation tools despite differences in language, education, and anesthesia practice, in an Israeli study, using validated scenarios from a multi-institutional United States (US) study. Thirty-one Israeli junior anesthesia residents performed four simulation scenarios. Training sessions were videotaped and performance was assessed using two validated scoring systems (Long and Short Forms) by two independent raters. Subjects scored from 37 to 95 (70 ± 12) of 108 possible points with the “Long Form” and “Short Form” scores ranging from 18 to 35 (28.2 ± 4.5) of 40 possible points. Scores >70% of the maximal score were achieved by 61% of participants in comparison to only 5% in the original US study. The scenarios were rated as very realistic by 80% of the participants (grade 4 on a 1–4 scale). Reliability of the original assessment tools was demonstrated by internal consistencies of 0.66 for the Long and 0.75 for the Short Form (Cronbach α statistic). Values in the original study were 0.72–0.76 for the Long and 0.71–0.75 for the Short Form. The reliability did not change when a revised Israeli version of the scoring was used. Interrater reliability measured by Pearson correlation was 0.91 for the Long and 0.96 for the Short Form (P < 0.01). The high scores for plausibility given to the scenarios and the similar reliability of the original assessment tool support the feasibility of using simulation-based evaluation tools, developed in the US, in Israel. The higher scores achieved by Israeli residents may be related to the fact that most Israeli residents are immigrants with previous training in anesthesia.This publication has 19 references indexed in Scilit:
- Acute Care Skills in Anesthesia PracticeAnesthesiology, 2004
- Full scale computer simulators in anesthesia training and evaluationCanadian Journal of Anesthesia/Journal canadien d'anesthésie, 2004
- Crisis resource management training for an anaesthesia faculty: a new approach to continuing educationMedical Education, 2004
- Evaluation of Anesthesia Residents Using Mannequin-based SimulationAnesthesiology, 2002
- Les simulateurs d’anesthésiologie: le travail en réseau est la cléCanadian Journal of Anesthesia/Journal canadien d'anesthésie, 2002
- Une enquête mondiale sur l’usage de la simulation en anesthésieCanadian Journal of Anesthesia/Journal canadien d'anesthésie, 2002
- The Use of a Human Patient Simulator in the Evaluation of and Development of a Remedial Prescription for an Anesthesiologist with Lapsed Medical SkillsAnesthesia & Analgesia, 2002
- Validity and reliability of undergraduate performance assessments in an anesthesia simulatorCanadian Journal of Anesthesia/Journal canadien d'anesthésie, 2001
- Evaluation of medical students' performance using the anaesthesia simulatorMedical Education, 2000
- Testing Internal Consistency and Construct Validity During Evaluation of Performance in a Patient SimulatorAnesthesia & Analgesia, 1998