Conducting Value for Money Analyses for Non-randomised Interventional Studies Including Service Evaluations: An Educational Review with Recommendations
Open Access
- 15 April 2020
- journal article
- review article
- Published by Springer Science and Business Media LLC in PharmacoEconomics
- Vol. 38 (7), 665-681
- https://doi.org/10.1007/s40273-020-00907-5
Abstract
This article provides an educational review covering the consideration of conducting ‘value for money’ analyses as part of non-randomised study designs including service evaluations. These evaluations represent a vehicle for producing evidence such as value for money of a care intervention or service delivery model. Decision makers including charities and local and national governing bodies often rely on evidence from non-randomised data and service evaluations to inform their resource allocation decision-making. However, as randomised data obtained from randomised controlled trials are considered the ‘gold standard’ for assessing causation, the use of this alternative vehicle for producing an evidence base requires careful consideration. We refer to value for money analyses, but reflect on methods associated with economic evaluations as a form of analysis used to inform resource allocation decision-making alongside a finite budget. Not all forms of value for money analysis are considered a full economic evaluation with implications for the information provided to decision makers. The type of value for money analysis to be conducted requires considerations such as the outcome(s) of interest, study design, statistical methods to control for confounding and bias, and how to quantify and describe uncertainty and opportunity costs to decision makers in any resulting value for money estimates. Service evaluations as vehicles for producing evidence present different challenges to analysts than what is commonly associated with research, randomised controlled trials and health technology appraisals, requiring specific study design and analytic considerations. This educational review describes and discusses these considerations, as overlooking them could affect the information provided to decision makers who may make an ‘ill-informed’ decision based on ‘poor’ or ‘inaccurate’ information with long-term implications. We make direct comparisons between randomised controlled trials relative to non-randomised data as vehicles for assessing causation; given ‘gold standard’ randomised controlled trials have limitations. Although we use UK-based decision makers as examples, we reflect on the needs of decision makers internationally for evidence-based decision-making specific to resource allocation. We make recommendations based on the experiences of the authors in the UK, reflecting on the wide variety of methods available, used as documented in the empirical literature. These methods may not have been fully considered relevant to non-randomised study designs and/or service evaluations, but could improve and aid the analysis conducted to inform the relevant value for money decision problem.Keywords
Funding Information
- National Institute for Health Research (NIHR200166)
This publication has 113 references indexed in Scilit:
- Public health economics: a systematic review of guidance for the economic evaluation of public health interventions and discussion of key methodological issuesBMC Public Health, 2013
- Do health economic evaluations using observational data provide reliable assessment of treatment effects?Health Economics Review, 2013
- Techniques for estimating health care costs with censored data: an overview for the health services researcherClinicoEconomics and Outcomes Research, 2012
- Ten arguments for a societal perspective in the economic evaluation of medical innovationsThe European Journal of Health Economics, 2009
- Use of economic evaluation in local health care decision-making in England: A qualitative investigationHealth Policy, 2009
- A systematic review of the use of economic evaluation in local decision-makingHealth Policy, 2008
- The NICE Cost-Effectiveness ThresholdPharmacoEconomics, 2008
- Efficiency and the proposed reforms to the NHS research ethics systemJournal of Medical Ethics, 2007
- Estimating Mean Total Costs in the Presence of CensoringPharmacoEconomics, 2005
- The Role of Cost-Consequence Analysis in Healthcare Decision-MakingPharmacoEconomics, 1998