Framework for the development and evaluation of complex interventions: gap analysis, workshop and consultation-informed update
Top Cited Papers
Open Access
- 1 September 2021
- journal article
- research article
- Published by National Institute for Health and Care Research in Health Technology Assessment
- Vol. 25 (57), 1-132
- https://doi.org/10.3310/hta25570
Abstract
Background The Medical Research Council published the second edition of its framework in 2006 on developing and evaluating complex interventions. Since then, there have been considerable developments in the field of complex intervention research. The objective of this project was to update the framework in the light of these developments. The framework aims to help research teams prioritise research questions and design, and conduct research with an appropriate choice of methods, rather than to provide detailed guidance on the use of specific methods. Methods There were four stages to the update: (1) gap analysis to identify developments in the methods and practice since the previous framework was published; (2) an expert workshop of 36 participants to discuss the topics identified in the gap analysis; (3) an open consultation process to seek comments on a first draft of the new framework; and (4) findings from the previous stages were used to redraft the framework, and final expert review was obtained. The process was overseen by a Scientific Advisory Group representing the range of relevant National Institute for Health Research and Medical Research Council research investments. Results Key changes to the previous framework include (1) an updated definition of complex interventions, highlighting the dynamic relationship between the intervention and its context; (2) an emphasis on the use of diverse research perspectives: efficacy, effectiveness, theory-based and systems perspectives; (3) a focus on the usefulness of evidence as the basis for determining research perspective and questions; (4) an increased focus on interventions developed outside research teams, for example changes in policy or health services delivery; and (5) the identification of six ‘core elements’ that should guide all phases of complex intervention research: consider context; develop, refine and test programme theory; engage stakeholders; identify key uncertainties; refine the intervention; and economic considerations. We divide the research process into four phases: development, feasibility, evaluation and implementation. For each phase we provide a concise summary of recent developments, key points to address and signposts to further reading. We also present case studies to illustrate the points being made throughout. Limitations The framework aims to help research teams prioritise research questions and design and conduct research with an appropriate choice of methods, rather than to provide detailed guidance on the use of specific methods. In many of the areas of innovation that we highlight, such as the use of systems approaches, there are still only a few practical examples. We refer to more specific and detailed guidance where available and note where promising approaches require further development. Conclusions This new framework incorporates developments in complex intervention research published since the previous edition was written in 2006. As well as taking account of established practice and recent refinements, we draw attention to new approaches and place greater emphasis on economic considerations in complex intervention research. We have introduced a new emphasis on the importance of context and the value of understanding interventions as ‘events in systems’ that produce effects through interactions with features of the contexts in which they are implemented. The framework adopts a pluralist approach, encouraging researchers and research funders to adopt diverse research perspectives and to select research questions and methods pragmatically, with the aim of providing evidence that is useful to decision-makers. Future work We call for further work to develop relevant methods and provide examples in practice. The use of this framework should be monitored and the move should be made to a more fluid resource in the future, for example a web-based format that can be frequently updated to incorporate new material and links to emerging resources. Funding This project was jointly funded by the Medical Research Council (MRC) and the National Institute for Health Research (Department of Health and Social Care 73514).Keywords
Funding Information
- Health Technology Assessment Programme (NIHR130621)
- Medical Research Council
This publication has 299 references indexed in Scilit:
- A Primer on Effectiveness and Efficacy TrialsClinical and Translational Gastroenterology, 2014
- Effectiveness-implementation Hybrid DesignsMedical Care, 2012
- Reducing Smoking in Adolescents: Cost-Effectiveness Results From the Cluster Randomized ASSIST (A Stop Smoking In Schools Trial)Nicotine & Tobacco Research, 2011
- An international, multicentre, prospective, randomised, controlled, unblinded, parallel-group trial of robotic-assisted versus standard laparoscopic surgery for the curative treatment of rectal cancerInternational Journal of Colorectal Disease, 2011
- Development of a self-report measure of capability wellbeing for adults: the ICECAP-AQuality of Life Research, 2011
- Enduring Effects of Prenatal and Infancy Home Visiting by Nurses on Maternal Life Course and Government SpendingArchives of Pediatrics & Adolescent Medicine, 2010
- An informal school-based peer-led intervention for smoking prevention in adolescence (ASSIST): a cluster randomised trialThe Lancet, 2008
- The Multiphase Optimization Strategy (MOST) and the Sequential Multiple Assignment Randomized Trial (SMART): New Methods for More Potent eHealth InterventionsAmerican Journal of Preventive Medicine, 2007
- Diffusion of Innovations in Service Organizations: Systematic Review and RecommendationsThe Milbank Quarterly, 2004