Reed, MS, Ferre, M, Martin-Ortega, J orcid.org/0000-0003-0002-6772 et al. (4 more authors) (2021) Evaluating impact from research: a methodological framework. Research Policy, 50 (4). 104147. ISSN 0048-7333
Abstract
Background
Interest in impact evaluation has grown rapidly as research funders increasingly demand evidence that their investments lead to public benefits.
Aims
This paper analyses literature to provide a new definition of research impact and impact evaluation, develops a typology of research impact evaluation designs, and proposes a methodological framework to guide evaluations of the significance and reach of impact that can be attributed to research.
Method
An adapted Grounded Theory Analysis of research impact evaluation frameworks drawn from cross-disciplinary peer-reviewed and grey literature.
Results
Recognizing the subjective nature of impacts as they are perceived by different groups in different times, places and cultures, we define research impact evaluation as the process of assessing the significance and reach of both positive and negative effects of research.
Five types of impact evaluation design are identified encompassing a range of evaluation methods and approaches: i) experimental and statistical methods; ii) textual, oral and arts-based methods; iii) systems analysis methods; iv) indicator-based approaches; and v) evidence synthesis approaches.
Our guidance enables impact evaluation design to be tailored to the aims and context of the evaluation, for example choosing a design to establish a body of research as a necessary (e.g. a significant contributing factor amongst many) or sufficient (e.g. sole, direct) cause of impact, and choosing the most appropriate evaluation design for the type of impact being evaluated.
Conclusion
Using the proposed definitions, typology and methodological framework, researchers, funders and other stakeholders working across multiple disciplines can select a suitable evaluation design and methods to evidence the impact of research from any discipline.
Metadata
Item Type: | Article |
---|---|
Authors/Creators: |
|
Copyright, Publisher and Additional Information: | © 2020 The Authors. Published by Elsevier B.V.. This is an author produced version of an article published in Research Policy. Uploaded in accordance with the publisher's self-archiving policy. |
Dates: |
|
Institution: | The University of Leeds |
Academic Units: | The University of Leeds > Faculty of Environment (Leeds) > School of Earth and Environment (Leeds) > Sustainability Research Institute (SRI) (Leeds) The University of Leeds > Faculty of Environment (Leeds) > School of Geography (Leeds) > River Basin Processes & Management (Leeds) |
Funding Information: | Funder Grant number NERC (Natural Environment Research Council) NE/P011160/1 NERC (Natural Environment Research Council) NE/P011160/1 |
Depositing User: | Symplectic Publications |
Date Deposited: | 02 Sep 2020 14:37 |
Last Modified: | 08 Jul 2022 01:45 |
Status: | Published |
Publisher: | Elsevier |
Identification Number: | 10.1016/j.respol.2020.104147 |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:165011 |
Download
Filename: Reed et al (in press) Evidencing impact - Research Policy copy.pdf
Licence: CC-BY-NC-ND 4.0