The Mayo High Performance Teamwork Scale: Reliability and Validity for Evaluating Key Crew Resource Management Skills
- 1 January 2007
- journal article
- research article
- Published by Ovid Technologies (Wolters Kluwer Health) in Simulation in healthcare : journal of the Society for Simulation in Healthcare
- Vol. 2 (1), 4-10
- https://doi.org/10.1097/sih.0b013e31802b68ee
Abstract
To develop and evaluate a participant rating scale for assessing high performance teamwork skills in simulation medicine settings. In all, 107 participants in crisis resource management (CRM) training in a multidisciplinary medical simulation center generated 273 ratings of key CRM skills after participating in two or three simulation exercises. These data were analyzed using Rasch and traditional psychometric approaches to develop the 16-item Mayo High Performance Teamwork Scale (MHPTS). Sensitivity to change as a result CRM training was also evaluated. The MHPTS showed satisfactory internal consistency and construct validity by Rasch (person reliability = 0.77; person separation = 1.85; item reliability = 0.96; item separation = 5.04) and traditional psychometric (Cronbach’s alpha = 0.85) indicators. The scale demonstrated sensitivity to change as a result of CRM training (pretraining mean = 21.44 versus first posttraining rating mean = 24.37; paired t = −4.15, P Conclusions: The MHPTS provides a brief, reliable, practical measure of CRM skills that can be used by participants in CRM training to reflect on and evaluate their performance as a team. Further evaluation of validity and appropriateness in other simulation and medical settings is desirable.Keywords
This publication has 10 references indexed in Scilit:
- A pilot study using high-fidelity simulation to formally evaluate performance in the resuscitation of critically ill patients: The University of Ottawa Critical Care Medicine, High-Fidelity Simulation, and Crisis Resource Management I StudyCritical Care Medicine, 2006
- The impact of aviation-based teamwork training on the attitudes of health-care professionalsJournal of the American College of Surgeons, 2004
- Objective measures of situation awareness in a simulated medical environmentQuality and Safety in Health Care, 2004
- Score comparability of short forms and computerized adaptive testing: simulation study with the activity measure for post-acute careArchives of Physical Medicine and Rehabilitation, 2004
- Further Psychometric Evaluation and Revision of the Mayo-Portland Adaptability Inventory in a National SampleJournal of Head Trauma Rehabilitation, 2003
- Anaesthetists’ Non-Technical Skills (ANTS): evaluation of a behavioural marker system † †Declaration of interest: The ANTS system was developed under research funding from the Scottish Council for Postgraduate Medical and Dental Education, now part of NHS Education for Scotland, through grants to the University of Aberdeen from September 1999 to August 2003. The views presented in this paper are those of the authors and should not be taken to represent the position or policy of the funding body.British Journal of Anaesthesia, 2003
- Evaluation of high fidelity patient simulator in assessment of performance of anaesthetistsBritish Journal of Anaesthesia, 2003
- Simulation-Based Training in Anesthesia Crisis Resource Management (ACRM): A Decade of ExperienceSimulation & Gaming, 2001
- Reporting and preventing medical mishaps: lessons from non-medical near miss reporting systemsBMJ, 2000
- The Performance of Intensive Care Units: Does Good Management Make a Difference?Medical Care, 1994