How do we define the policy impact of public health research? A systematic review
Open Access
- 2 October 2017
- journal article
- review article
- Published by Springer Science and Business Media LLC in Health Research Policy and Systems
- Vol. 15 (1), 1-12
- https://doi.org/10.1186/s12961-017-0247-z
Abstract
In order to understand and measure the policy impact of research we need a definition of research impact that is suited to the task. This article systematically reviewed both peer-reviewed and grey literature for definitions of research impact to develop a definition of research impact that can be used to investigate how public health research influences policy. Keyword searches of the electronic databases Web of Science, ProQuest, PubMed, EMBASE, CINAHL, Informit, PsycINFO, The Cochrane Database of Systematic Reviews and Google Scholar were conducted between August 2015 and April 2016. Keywords included ‘definition’ and ‘policy’ and ‘research impact’ or ‘research evidence’. The search terms ‘health’, public health’ or ‘mental health’ and ‘knowledge transfer’ or ‘research translation’ were used to focus the search on relevant health discipline approaches. Studies included in the review described processes, theories or frameworks associated with public health, health services or mental health policy. We identified 108 definitions in 83 publications. The key findings were that literature on research impact is growing, but only 23% of peer-reviewed publications on the topic explicitly defined the term and that the majority (76%) of definitions were derived from research organisations and funding institutions. We identified four main types of definition, namely (1) definitions that conceptualise research impacts in terms of positive changes or effects that evidence can bring about when transferred into policies (example Research Excellence Framework definition), (2) definitions that interpret research impacts as measurable outcomes (Research Councils UK), and (3) bibliometric and (4) use-based definitions. We identified four constructs underpinning these definitions that related to concepts of contribution, change, avenues and levels of impact. The dominance of bureaucratic definitions, the tendency to discuss but not define the concept of research impact, and the heterogeneity of definitions confirm the need for conceptual clarity in this area. We propose a working definition of research impact that can be used in a range of health policy contexts.Keywords
Funding Information
- National Health and Medical Research Council (AU) Centre for Research Excellence in Mental Health Systems Improvment (APP1041131)
- Australian Government Research Training Program Scholarship from the University of Queensland (UQ)
This publication has 55 references indexed in Scilit:
- Policy and practice impacts of applied research: a case study analysis of the New South Wales Health Promotion Demonstration Research Grants Scheme 2000–2006Health Research Policy and Systems, 2013
- Assessing research impact in academic clinical medicine: a study using Research Excellence Framework pilot impact indicatorsBMC Health Services Research, 2012
- Research performance of centers of expertise for rare diseases—The influence of network integration, internal resource access and operational experienceHealth Policy, 2012
- Conceptual frameworks and empirical approaches used to assess the impact of health research: an overview of reviewsHealth Research Policy and Systems, 2011
- Metrics: Do metrics matter?Nature, 2010
- Monitoring use of knowledge and evaluating outcomesCMAJ : Canadian Medical Association Journal, 2010
- Understanding Evidence-Based Public Health PolicyAmerican Journal of Public Health, 2009
- The feasibility of determining the impact of primary health care research projects using the Payback FrameworkHealth Research Policy and Systems, 2009
- Assessing the impact of research on policy: a literature reviewScience and Public Policy, 2009
- Achieving ‘best practice’ in health promotion: improving the fit between research and practiceHealth Education Research, 1996