Development and Verification of a Digital Twin Patient Model to Predict Specific Treatment Response During the First 24 Hours of Sepsis
Open Access
- 16 November 2020
- journal article
- case report
- Published by Ovid Technologies (Wolters Kluwer Health) in Critical Care Explorations
- Vol. 2 (11), e0249
- https://doi.org/10.1097/cce.0000000000000249
Abstract
Objectives: To develop and verify a digital twin model of critically ill patient using the causal artificial intelligence approach to predict the response to specific treatment during the first 24 hours of sepsis. Design: Directed acyclic graphs were used to define explicitly the causal relationship among organ systems and specific treatments used. A hybrid approach of agent-based modeling, discrete-event simulation, and Bayesian network was used to simulate treatment effect across multiple stages and interactions of major organ systems (cardiovascular, neurologic, renal, respiratory, gastrointestinal, inflammatory, and hematology). Organ systems were visualized using relevant clinical markers. The application was iteratively revised and debugged by clinical experts and engineers. Agreement statistics was used to test the performance of the model by comparing the observed patient response versus the expected response (primary and secondary) predicted by digital twin. Setting: Medical ICU of a large quaternary- care academic medical center in the United States. Patients or Subjects: Adult (> 18 year yr old), medical ICU patients were included in the study. Interventions: No additional interventions were made beyond the standard of care for this study. Measurements and Main Results: During the verification phase, model performance was prospectively tested on 145 observations in a convenience sample of 29 patients. Median age was 60 years (54–66 d) with a median Sequential Organ Failure Assessment score of 9.5 (interquartile range, 5.0–14.0). The most common source of sepsis was pneumonia, followed by hepatobiliary. The observations were made during the first 24 hours of the ICU admission with one-step interventions, comparing the output in the digital twin with the real patient response. The agreement between the observed versus and the expected response ranged from fair (kappa coefficient of 0.41) for primary response to good (kappa coefficient of 0.65) for secondary response to the intervention. The most common error detected was coding error in 50 observations (35%), followed by expert rule error in 29 observations (20%) and timing error in seven observations (5%). Conclusions: We confirmed the feasibility of development and prospective testing of causal artificial intelligence model to predict the response to treatment in early stages of critical illness. The availability of qualitative and quantitative data and a relatively short turnaround time makes the ICU an ideal environment for development and testing of digital twin patient models. An accurate digital twin model will allow the effect of an intervention to be tested in a virtual environment prior to use on real patients.Keywords
This publication has 21 references indexed in Scilit:
- Directed acyclic graphs: a tool for causal studies in paediatricsPediatric Research, 2018
- Recognizing Sepsis as a Global Health Priority — A WHO ResolutionThe New England Journal of Medicine, 2017
- MIMIC-III, a freely accessible critical care databaseScientific Data, 2016
- The Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3)JAMA, 2016
- Data Utilization for Medical Decision Making at the Time of Patient Admission to ICU*Critical Care Medicine, 2013
- Short-term mortality prediction for acute lung injury patients: External validation of the Acute Respiratory Distress Syndrome Network prediction model*Critical Care Medicine, 2011
- Pattern-Oriented Modeling of Agent-Based Complex Systems: Lessons from EcologyScience, 2005
- ArchimedesDiabetes Care, 2003
- Early Goal-Directed Therapy in the Treatment of Severe Sepsis and Septic ShockThe New England Journal of Medicine, 2001
- The computational complexity of probabilistic inference using bayesian belief networksArtificial Intelligence, 1990