Evaluating the demand side: New challenges for evaluation
- 15 February 2012
- journal article
- Published by Oxford University Press (OUP) in Research Evaluation
- Vol. 21 (1), 33-47
- https://doi.org/10.1093/reseval/rvr002
Abstract
Evaluation of research and innovation policy faces radical challenges arising from a new policy emphasis upon demand-side measures and linked to this an understanding of innovation policy as a means to achieve societal goals. This article considers the implications for the practice of evaluation at both micro and meso-levels. It uses the exemplar of an evaluation design for the European Union's Lead Market Initiative to expose the extent to which classical approaches to evaluation are valid and where new issues arise. Some problems highlighted include the difficulty of establishing a relevant baseline, the inability of public statistics constructed in supply-side mode to capture actions, the need to engage with actors who do not necessarily see themselves as part of the initiative being evaluated, long timescales and potential wide geographical scope, measures that span from micro to macro, and blurred boundaries between implementation and impact. It is concluded that there is a key role for evaluators to become involved in co-learning and co-evolution of these policy instruments in a manner analogous to the relationship between evaluation and policy development that characterized the emergence of collaborative R&D support programmes.Keywords
This publication has 17 references indexed in Scilit:
- The influence of regulations on innovation: A quantitative assessment for OECD countriesResearch Policy, 2012
- Reconceptualising the ‘policy mix’ for innovationResearch Policy, 2011
- How stakeholders view the impacts of international ICT standardsTelecommunications Policy, 2009
- Improving policy understanding by means of secondary analyses of policy evaluationResearch Evaluation, 2008
- Europe's research system must changeNature, 2008
- The impact of patents and standards on macroeconomic growth: a panel approach covering four countries and 12 sectorsJournal of Productivity Analysis, 2007
- Trade and the impact of innovations and standards: the case of Germany and the UKApplied Economics, 2005
- Assessing the lead market potential of countries for innovation projectsJournal of International Management, 2004
- Lead markets: country-specific drivers of the global diffusion of innovationsResearch Policy, 2004
- A Propositional Inventory for New Diffusion ResearchJournal of Consumer Research, 1985