Influence of task properties and subjectivity on consistency of triage: a simulation study
- 19 April 2007
- journal article
- research article
- Published by Wiley in Journal of Advanced Nursing
- Vol. 58 (2), 180-190
- https://doi.org/10.1111/j.1365-2648.2007.04192.x
Abstract
Title. Influence of task properties and subjectivity on consistency of triage: a simulation study Aim. This paper reports a study to determine nurses’ levels of agreement using a standard 5-point triage scale and to explore the influence of task properties and subjectivity on decision-making consistency. Background. Triage scales are used to define time-to-treatment in hospital emergency departments. Studies of the inter-rater reliability of these scales using paper-based simulation methods report varying levels of consistency. Understanding how various components of the decision task and individual perceptions of the case influence agreement is critical to the development of strategies to improve consistency of triage. Method. Simulations were constructed from naturalistic observation, cue types and frequencies were classified. Data collection was conducted in 2002, and the final response rate was 41·3%. Participants were asked to allocate an urgency code for 12 scenarios using the Australasian Triage Scale, and provide estimates of case complexity, levels of certainty and available information. Data were analysed descriptively, agreement between raters was calculated using kappa. The influence of task properties and participants’ subjective estimates of case complexity, levels of certainty and available information on agreement were explored using a general linear model. Findings. Agreement among raters varied from moderate to poor (κ = 0·18–0·64). Participants’ subjective estimates of levels of available information were found to influence consistency of triage by statistically significant amounts (F 5·68; ≤0·01). Conclusions. Strategies employed to optimize consistency of triage should focus on improving the quality of the simulations that are used. In particular, attention should be paid to the development of interactive simulations that will accommodate individual differences in information-seeking behaviour.Keywords
This publication has 18 references indexed in Scilit:
- The Australasian Triage Scale: Examining emergency department nurses' performance using computer and paper scenariosAnnals of Emergency Medicine, 2004
- The future vision of simulation in health careQuality and Safety in Health Care, 2004
- The Emergency Severity Index (version 3) 5-Level Triage System Scores Predict ED Resource ConsumptionJournal of Emergency Nursing, 2004
- Achieving Quality in Clinical Decision Making: Cognitive Strategies and Detection of BiasAcademic Emergency Medicine, 2002
- Victorian nurses demonstrate concordance in the application of the National Triage ScaleEmergency Medicine, 1998
- Inter‐rater reliability of the National Triage Scale over 11,500 simulated occasions of triageEmergency Medicine, 1996
- How Convergence of Research Paradigms Can Improve Research on Diagnostic JudgmentMedical Decision Making, 1996
- Large sample variance of kappa in the case of different sets of raters.Psychological Bulletin, 1979
- Assessing Inter-Rater Reliability for Rating Scales: Resolving some Basic IssuesThe British Journal of Psychiatry, 1976