A Multi-Fidelity Rollout Algorithm for Dynamic Resource Allocation in Population Disease Management
- 7 September 2018
- journal article
- research article
- Published by Springer Science and Business Media LLC in Health Care Management Science
- Vol. 22 (4), 727-755
- https://doi.org/10.1007/s10729-018-9454-6
Abstract
Dynamic resource allocation for prevention, screening, and treatment interventions in population disease management has received much attention in recent years due to excessive healthcare costs. In this paper, our goal is to design a model and an efficient algorithm to optimize sequential intervention policies under resource constraints to improve population health outcomes. We consider a discrete-time finite-horizon budget allocation problem with disease progression within a closed birth-cohort population. To address the computational challenges associated with large-state and multiple-period dynamic decision-making problems, we propose a low-fidelity approximation that preserves the population dynamics under a stationary policy. To improve the healthcare interventions in terms of population health outcomes, we then embed the low-fidelity approximation into a high-fidelity optimization model to efficiently identify a good non-stationary sequential intervention policy. Our approach is illustrated by a numerical example of screening and treatment policy implementation for chronic hepatitis C virus (HCV) infection over a budget planning period. We numerically compare our Multi-Fidelity Rollout Algorithm (MF-RA) to a grid search approach and demonstrate the similarity of sequential policy trends and closeness of overall health outcomes measured by quality-adjusted life-years (QALYs) and the total number of individuals that undergo screening and treatment for different annual budgets and birth-cohorts. We also show how our approach scales well to problems with high dimensionality due to many decision periods by studying time to elimination of HCV.Keywords
This publication has 71 references indexed in Scilit:
- Rollout Algorithms for Discrete Optimization: A SurveyPublished by Springer Science and Business Media LLC ,2013
- HIV epidemic control—a model for optimal allocation of prevention and treatment resourcesHealth Care Management Science, 2013
- Fairness, Efficiency, and Flexibility in Organ Allocation for Kidney TransplantationOperations Research, 2013
- OR Forum—A POMDP Approach to Personalize Mammography Screening DecisionsOperations Research, 2012
- Markov Decision Processes: A Tool for Sequential Decision Making under UncertaintyMedical Decision Making, 2009
- Determining the Acceptance of Cadaveric Livers Using an Implicit Model of the Waiting ListOperations Research, 2007
- The Optimal Timing of Living-Donor Liver TransplantationManagement Science, 2004
- The Natural History of Late-Life DepressionArchives of General Psychiatry, 2002
- The Prevalence of Hepatitis C Virus Infection in the United States, 1988 through 1994The New England Journal of Medicine, 1999
- Rollout Algorithms for Combinatorial OptimizationJournal of Heuristics, 1997