Oxford NOTECHS II: A Modified Theatre Team Non-Technical Skills Scoring System
Open Access
- 4 March 2014
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 9 (3), e90320
- https://doi.org/10.1371/journal.pone.0090320
Abstract
We previously developed and validated the Oxford NOTECHS rating system for evaluating the non-technical skills of an entire operating theatre team. Experience with the scale identified the need for greater discrimination between levels of performance within the normal range. We report here the development of a modified scale (Oxford NOTECHS II) to facilitate this. The new measure uses an eight-point instead of a four point scale to measure each dimension of non-technical skills, and begins with a default rating of 6 for each element. We evaluated this new scale in 297 operations at five NHS sites in four surgical specialities. Measures of theatre process reliability (glitch count) and compliance with the WHO surgical safety checklist were scored contemporaneously, and relationships with NOTECHS II scores explored. Mean team Oxford NOTECHS II scores was 73.39 (range 37–92). The means for surgical, anaesthetic and nursing sub-teams were 24.61 (IQR 23, 27); 24.22 (IQR 23, 26) and 24.55 (IQR 23, 26). Oxford NOTECHS II showed good inter-rater reliability between human factors and clinical observers in each of the four domains. Teams with high WHO compliance had higher mean Oxford NOTECHS II scores (74.5) than those with low compliance (71.1) (p = 0.010). We observed only a weak correlation between Oxford NOTECHS II scores and glitch count; r = −0.26 (95% CI −0.36 to −0.15). Oxford NOTECHS II scores did not vary significantly between 5 different hospital sites, but a significant difference was seen between specialities (p = 0.001). Oxford NOTECHS II provides good discrimination between teams while retaining reliability and correlation with other measures of teamwork performance, and is not confounded by technical performance. It is therefore suitable for combined use with a technical performance scale to provide a global description of operating theatre team performance.Keywords
This publication has 29 references indexed in Scilit:
- Utility and assessment of non‐technical skills for rapid response systems and medical emergency teamsInternal Medicine Journal, 2013
- Development and reliability of the explicit professional oral communication observation tool to quantify the use of non-technical skills in healthcareBMJ Quality & Safety, 2013
- Using the Objective Structured Assessment of Technical Skills (OSATS) global rating scale to evaluate the skills of surgical trainees in the operating roomSurgery Today, 2012
- Evaluation of surgical team performance in elective operative theatresInternational Journal of Surgery, 2011
- The development of process maps in the training of surgical and human factors observers in orthopaedic surgeryInternational Journal of Surgery, 2011
- A Multicenter Trial of Aviation-Style Training for Surgical TeamsJournal of Patient Safety, 2010
- The Oxford NOTECHS System: reliability and validity of a tool for measuring teamwork behaviour in the operating theatreQuality and Safety in Health Care, 2009
- Preserving professional credibility: grounded theory study of medical trainees' requests for clinical supportBMJ, 2009
- Communication failures in the operating room: an observational classification of recurrent types and effectsQuality and Safety in Health Care, 2004
- Team Communications in the Operating RoomAcademic Medicine, 2002