Development and validation of a prognostic COVID-19 severity assessment (COSA) score and machine learning models for patient triage at a tertiary hospital
Open Access
- 5 February 2021
- journal article
- research article
- Published by Springer Science and Business Media LLC in Journal of Translational Medicine
- Vol. 19 (1), 1-11
- https://doi.org/10.1186/s12967-021-02720-w
Abstract
Background Clinical risk scores and machine learning models based on routine laboratory values could assist in automated early identification of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) patients at risk for severe clinical outcomes. They can guide patient triage, inform allocation of health care resources, and contribute to the improvement of clinical outcomes. Methods In- and out-patients tested positive for SARS-CoV-2 at the Insel Hospital Group Bern, Switzerland, between February 1st and August 31st (‘first wave’, n = 198) and September 1st through November 16th 2020 (‘second wave’, n = 459) were used as training and prospective validation cohort, respectively. A clinical risk stratification score and machine learning (ML) models were developed using demographic data, medical history, and laboratory values taken up to 3 days before, or 1 day after, positive testing to predict severe outcomes of hospitalization (a composite endpoint of admission to intensive care, or death from any cause). Test accuracy was assessed using the area under the receiver operating characteristic curve (AUROC). Results Sex, C-reactive protein, sodium, hemoglobin, glomerular filtration rate, glucose, and leucocytes around the time of first positive testing (− 3 to + 1 days) were the most predictive parameters. AUROC of the risk stratification score on training data (AUROC = 0.94, positive predictive value (PPV) = 0.97, negative predictive value (NPV) = 0.80) were comparable to the prospective validation cohort (AUROC = 0.85, PPV = 0.91, NPV = 0.81). The most successful ML algorithm with respect to AUROC was support vector machines (median = 0.96, interquartile range = 0.85–0.99, PPV = 0.90, NPV = 0.58). Conclusion With a small set of easily obtainable parameters, both the clinical risk stratification score and the ML models were predictive for severe outcomes at our tertiary hospital center, and performed well in prospective validation.This publication has 41 references indexed in Scilit:
- Risk Factors Associated With Acute Respiratory Distress Syndrome and Death in Patients With Coronavirus Disease 2019 Pneumonia in Wuhan, ChinaJAMA Internal Medicine, 2020
- Critical Care Utilization for the COVID-19 Outbreak in Lombardy, ItalyJAMA, 2020
- Characteristics of and Important Lessons From the Coronavirus Disease 2019 (COVID-19) Outbreak in ChinaJAMA, 2020
- Clinical course and risk factors for mortality of adult inpatients with COVID-19 in Wuhan, China: a retrospective cohort studyThe Lancet, 2020
- Procalcitonin in patients with severe coronavirus disease 2019 (COVID-19): A meta-analysisClinica Chimica Acta; International Journal of Clinical Chemistry, 2020
- A new coronavirus associated with human respiratory disease in ChinaNature, 2020
- Connecting With Patients—The Missing LinksJAMA, 2020
- Development of scoring system for risk stratification in clinical medicine: a step-by-step tutorialAnnals of Translational Medicine, 2017