Ensemble learning predicts multiple sclerosis disease course in the SUMMIT study
Open Access
- 16 October 2020
- journal article
- research article
- Published by Springer Science and Business Media LLC in npj Digital Medicine
- Vol. 3 (1), 1-8
- https://doi.org/10.1038/s41746-020-00338-8
Abstract
The rate of disability accumulation varies across multiple sclerosis (MS) patients. Machine learning techniques may offer more powerful means to predict disease course in MS patients. In our study, 724 patients from the Comprehensive Longitudinal Investigation in MS at Brigham and Women’s Hospital (CLIMB study) and 400 patients from the EPIC dataset, University of California, San Francisco, were included in the analysis. The primary outcome was an increase in Expanded Disability Status Scale (EDSS) ≥ 1.5 (worsening) or not (non-worsening) at up to 5 years after the baseline visit. Classification models were built using the CLIMB dataset with patients’ clinical and MRI longitudinal observations in first 2 years, and further validated using the EPIC dataset. We compared the performance of three popular machine learning algorithms (SVM, Logistic Regression, and Random Forest) and three ensemble learning approaches (XGBoost, LightGBM, and a Meta-learner L). A “threshold” was established to trade-off the performance between the two classes. Predictive features were identified and compared among different models. Machine learning models achieved 0.79 and 0.83 AUC scores for the CLIMB and EPIC datasets, respectively, shortly after disease onset. Ensemble learning methods were more effective and robust compared to standalone algorithms. Two ensemble models, XGBoost and LightGBM were superior to the other four models evaluated in our study. Of variables evaluated, EDSS, Pyramidal Function, and Ambulatory Index were the top common predictors in forecasting the MS disease course. Machine learning techniques, in particular ensemble methods offer increased accuracy for the prediction of MS disease course.Keywords
This publication has 18 references indexed in Scilit:
- Natural History of Multiple Sclerosis: Early Prognostic FactorsNeurologic Clinics, 2011
- Reduction of Disease Activity and Disability With High-Dose Cyclophosphamide in Patients With Aggressive Multiple SclerosisArchives of Neurology, 2008
- Effect of early versus delayed interferon beta-1b treatment on disability after a first clinical event suggestive of multiple sclerosis: a 3-year follow-up analysis of the BENEFIT studyThe Lancet, 2007
- Natural History of Multiple Sclerosis with Childhood OnsetThe New England Journal of Medicine, 2007
- Age at disability milestones in multiple sclerosisBrain, 2006
- Early clinical predictors and progression of irreversible disability in multiple sclerosis: an amnesic processBrain, 2003
- A prospective study on the prognosis of multiple sclerosisNeurological Sciences, 2000
- THE NATURAL HISTORY OF MULTIPLE SCLEROSIS: A GEOGRAPHICALLY BASED STUDYBrain, 1989
- THE NATURAL HISTORY OF MULTIPLE SCLEROSIS: A GEOGRAPHICALLY BASED STUDYBrain, 1989
- Rating neurologic impairment in multiple sclerosisNeurology, 1983