Comparing the use of global rating scale with checklists for the assessment of central venous catheterization skills using simulation
- 30 August 2011
- journal article
- Published by Springer Science and Business Media LLC in Advances in Health Sciences Education
- Vol. 17 (4), 457-470
- https://doi.org/10.1007/s10459-011-9322-3
Abstract
The use of checklists is recommended for the assessment of competency in central venous catheterization (CVC) insertion. To explore the use of a global rating scale in the assessment of CVC skills, this study seeks to compare its use with two checklists, within the context of a formative examination using simulation. Video-recorded performances of CVC insertion by 34 first-year medical residents were reviewed by two independent, trained evaluators. Each evaluator used three assessment tools: a ten-item checklist, a 21-item checklist, and a nine-item global rating scale. Exploratory principal component analysis of the global rating scale revealed two factors, accounting for 84.1% of the variance: technical ability and safety. The two checklist scores correlated positively with the weighted factor score on technical ability (0.49 [95% CI 0.17–0.71] for the 10-item checklist; 0.43 [95% CI 0.10–0.67] for the 21-item checklist) and negatively with the weighted factor score on safety (−0.17 [95% CI −0.48–0.18] for the 10-item checklist; −0.13 [95% CI −0.45–0.22] for the 21-item checklist). A checklist score of 80% on both checklists. All these candidates committed serious errors. In conclusion, the practice of universal adoption of checklists as the preferred method of assessment of procedural skills should be questioned. The inclusion of global rating scales should be considered.Keywords
This publication has 23 references indexed in Scilit:
- Simulation and patient safety: evaluative checklists for central venous catheter insertionQuality and Safety in Health Care, 2010
- Improving internal medicine residents' performance, knowledge, and confidence in central venous catheterization using simulatorsJournal of Hospital Medicine, 2009
- Mastery Learning of Temporary Hemodialysis Catheter Insertion by Nephrology Fellows Using Simulation Technology and Deliberate PracticeAmerican Journal of Kidney Diseases, 2009
- Checklists for assessment and certification of clinical procedural skills omit essential competencies: a systematic reviewMedical Education, 2008
- Editorial – Checklists vs. Ratings, the Illusion of Objectivity, the Demise of Skills and the Debasement of EvidenceAdvances in Health Sciences Education, 2005
- Injuries and Liability Related to Central Vascular CathetersAnesthesiology, 2004
- Preventing Complications of Central Venous CatheterizationNew England Journal of Medicine, 2003
- Pitfalls in the pursuit of objectivity: issues of validity, efficiency and acceptabilityMedical Education, 1991
- Pitfalls in the pursuit of objectivity: issues of reliabilityMedical Education, 1991
- The Scree Test For The Number Of FactorsMultivariate Behavioral Research, 1966