A prospective evaluation of AI-augmented epidemiology to forecast COVID-19 in the USA and Japan
Open Access
- 8 October 2021
- journal article
- research article
- Published by Springer Science and Business Media LLC in npj Digital Medicine
- Vol. 4 (1), 1-18
- https://doi.org/10.1038/s41746-021-00511-7
Abstract
The COVID-19 pandemic has highlighted the global need for reliable models of disease spread. We propose an AI-augmented forecast modeling framework that provides daily predictions of the expected number of confirmed COVID-19 deaths, cases, and hospitalizations during the following 4 weeks. We present an international, prospective evaluation of our models’ performance across all states and counties in the USA and prefectures in Japan. Nationally, incident mean absolute percentage error (MAPE) for predicting COVID-19 associated deaths during prospective deployment remained consistently <8% (US) and <29% (Japan), while cumulative MAPE remained <2% (US) and <10% (Japan). We show that our models perform well even during periods of considerable change in population behavior, and are robust to demographic differences across different geographic locations. We further demonstrate that our framework provides meaningful explanatory insights with the models accurately adapting to local and national policy interventions. Our framework enables counterfactual simulations, which indicate continuing Non-Pharmaceutical Interventions alongside vaccinations is essential for faster recovery from the pandemic, delaying the application of interventions has a detrimental effect, and allow exploration of the consequences of different vaccination strategies. The COVID-19 pandemic remains a global emergency. In the face of substantial challenges ahead, the approach presented here has the potential to inform critical decisions.Keywords
This publication has 73 references indexed in Scilit:
- Forecasting seasonal outbreaks of influenzaProceedings of the National Academy of Sciences of the United States of America, 2012
- Barriers to Health Care among the Elderly in JapanInternational Journal of Environmental Research and Public Health, 2010
- Seventy-five years of estimating the force of infection from current status dataEpidemiology and Infection, 2009
- Time series analysis via mechanistic modelsThe Annals of Applied Statistics, 2009
- The dynamics of a new SIR epidemic model concerning pulse vaccination strategyApplied Mathematics and Computation, 2008
- Strictly Proper Scoring Rules, Prediction, and EstimationJournal of the American Statistical Association, 2007
- Modeling epidemics using cellular automataApplied Mathematics and Computation, 2006
- Testing the null hypothesis of stationarity against the alternative of a unit root: How sure are we that economic time series have a unit root?Journal of Econometrics, 1992
- A Learning Algorithm for Continually Running Fully Recurrent Neural NetworksNeural Computation, 1989
- Reaction-Diffusion Models for the Spread of a Class of Infectious DiseasesPublished by Springer Science and Business Media LLC ,1988