Personalized Multimorbidity Management for Patients with Type 2 Diabetes Using Reinforcement Learning of Electronic Health Records
- 11 February 2021
- journal article
- research article
- Published by Springer Science and Business Media LLC in Drugs
- Vol. 81 (4), 471-482
- https://doi.org/10.1007/s40265-020-01435-4
Abstract
Background Comorbid chronic conditions are common among people with type 2 diabetes. We developed an artificial intelligence algorithm, based on reinforcement learning (RL), for personalized diabetes and multimorbidity management, with strong potential to improve health outcomes relative to current clinical practice. Methods We modeled glycemia, blood pressure, and cardiovascular disease (CVD) risk as health outcomes, using a retrospective cohort of 16,665 patients with type 2 diabetes from New York University Langone Health ambulatory care electronic health records in 2009–2017. We trained an RL prescription algorithm that recommends a treatment regimen optimizing patients’ cumulative health outcomes using their individual characteristics and medical history at each encounter. The RL recommendations were evaluated on an independent subset of patients. Results The single-outcome optimization RL algorithms, RL–glycemia, RL–blood pressure, and RL–CVD, recommended consistent prescriptions as that observed by clinicians in 86.1%, 82.9%, and 98.4% of the encounters, respectively. For patient encounters in which the RL recommendations differed from the clinician prescriptions, significantly fewer encounters showed uncontrolled glycemia (A1c > 8% in 35% of encounters), uncontrolled hypertension (blood pressure > 140 mmHg in 16% of encounters), and high CVD risk (risk > 20% in 25% of encounters) under RL algorithms compared with those observed under clinicians (43%, 27%, and 31% of encounters, respectively; all p < 0.001). Conclusions A personalized RL prescriptive framework for type 2 diabetes yielded high concordance with clinicians’ prescriptions, and substantial improvements in glycemia, blood pressure, and CVD risk outcomes.Funding Information
- National Institute on Aging (R01AG054467, R01AG065330)
This publication has 27 references indexed in Scilit:
- Managing patients with multimorbidity: systematic review of interventions in primary care and community settingsBMJ, 2012
- Epidemiology of multimorbidity and implications for health care, research, and medical education: a cross-sectional studyThe Lancet, 2012
- Measures of Multimorbidity and Morbidity Burden for Use in Primary Care and Community Settings: A Systematic Review and GuideAnnals of Family Medicine, 2012
- Medication adherence: A call for actionAmerican Heart Journal, 2011
- Reinforcement Learning Strategies for Clinical Trials in Nonsmall Cell Lung CancerBiometrics, 2011
- General Cardiovascular Risk Profile for Use in Primary CareCirculation, 2008
- Eligibility Criteria of Randomized Controlled Trials Published in High-Impact General Medical JournalsJAMA, 2007
- How to measure comorbiditya critical review of available methodsJournal of Clinical Epidemiology, 2003
- Reinforcement Learning: An IntroductionIEEE Transactions on Neural Networks, 1998
- Prevalence of Hypertension in the US Adult PopulationHypertension, 1995