Cross-validation of two prognostic trauma scores in severely injured patients
Open Access
- 21 April 2020
- journal article
- research article
- Published by Springer Science and Business Media LLC in European Journal of Trauma and Emergency Surgery
- Vol. 47 (6), 1837-1845
- https://doi.org/10.1007/s00068-020-01373-6
Abstract
Introduction Trauma scoring systems are important tools for outcome prediction and severity adjustment that informs trauma quality assessment and research. Discrimination and precision of such systems is tested in validation studies. The German TraumaRegister DGU(R) (TR-DGU) and the Trauma Audit and Research Network (TARN) from the UK agreed on a cross-validation study to validate their prediction scores (RISC II and PS14, respectively). Methods Severe trauma patients with an Injury Severity Score (ISS) >= 9 documented in 2015 and 2016 were selected in both registries (primary admissions only). The predictive scores from each registry were applied to the selected data sets. Observed and predicted mortality were compared to assess precision; area under the receiver operating characteristic curve was used for discrimination. Hosmer-Lemeshow statistic was calculated for calibration. A subgroup analysis including patients treated in intensive care unit (ICU) was also carried out. Results From TR-DGU, 40,638 patients were included (mortality 11.7%). The RISC II predicted mortality was 11.2%, while PS14 predicted 16.9% mortality. From TARN, 64,622 patients were included (mortality 9.7%). PS14 predicted 10.6% mortality, while RISC II predicted 17.7%. Despite the identical cutoff of ISS >= 9, patient groups from both registries showed considerable difference in need for intensive care (88% versus 18%). Subgroup analysis of patients treated on ICU showed nearly identical values for observed and predicted mortality using RISC II. Discussion Each score performed well within its respective registry, but when applied to the other registry a decrease in performance was observed. Part of this loss of performance could be explained by different development data sets: the RISC II is mainly based on patients treated in an ICU, while the PS14 includes cases mainly cared for outside ICU with more moderate injury severity. This is according to the respective inclusion criteria of the two registries. Conclusion External validations of prediction models between registries are needed, but may show that prediction models are not fully transferable to other health-care settings.This publication has 13 references indexed in Scilit:
- Prediction modelling for trauma using comorbidity and ‘true’ 30-day outcomeEmergency Medicine Journal, 2015
- Validation of the revised injury severity classification score in patients with moderate-to-severe traumatic brain injuryInjury, 2015
- Update of the trauma risk adjustment model of the TraumaRegister DGU™: the Revised Injury Severity Classification, version IICritical Care, 2014
- Introduction of a novel trauma scoreThe Journal of Trauma and Acute Care Surgery, 2012
- Development and validation of the revised injury severity classification score for severely injured patientsEuropean Journal of Trauma and Emergency Surgery, 2009
- The Utstein template for uniform reporting of data following major trauma: a joint revision by SCANTEM, TARN, DGU-TR and RITGScandinavian Journal of Trauma, Resuscitation and Emergency Medicine, 2008
- The Major Trauma Outcome Study: establishing national norms for trauma care.1990
- The Major Trauma Outcome StudyThe Journal of Trauma and Acute Care Surgery, 1990
- A new method of classifying prognostic comorbidity in longitudinal studies: Development and validationJournal of Chronic Diseases, 1987
- PanelThe Journal of Trauma and Acute Care Surgery, 1983