Doyle, N.E., McDowall, A., Randall, R. orcid.org/0000-0002-6991-9037 et al. (1 more author) (2022) Does it work? Using a Meta-Impact score to examine global effects in quasi-experimental intervention studies. PLoS ONE, 17 (3). e0265312. ISSN 1932-6203
Abstract
The evaluation of applied psychological interventions in the workplace or elsewhere is challenging. Randomisation and matching are difficult to achieve and this often results in substantial heterogeneity within intervention and control groups. As a result, traditional comparison of group means using null hypothesis significance testing may mask effects experienced by some participants. Using longitudinal studies of coaching interventions designed to provide support for dyslexic employees, this study describes and evaluates a different approach using a Meta-Impact score. We offer a conceptual rationale for our method, illustrate how this score is calculated and analysed, and show how it highlights person-specific variations in how participants react and respond to interventions. We argue that Meta-Impact is an incremental supplement to traditional variable-centric group-wise comparisons and can more accurately demonstrate in practice the extent to which an intervention worked. Such methods are needed for applied research, where personalized intervention protocols may require impact analysis for policy, legal and ethical purposes, despite modest sample sizes.
Metadata
Item Type: | Article |
---|---|
Authors/Creators: |
|
Copyright, Publisher and Additional Information: | © 2022 The Authors. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited (http://creativecommons.org/licenses/by/4.0/). |
Dates: |
|
Institution: | The University of Sheffield |
Academic Units: | The University of Sheffield > Faculty of Social Sciences (Sheffield) > Management School (Sheffield) |
Depositing User: | Symplectic Sheffield |
Date Deposited: | 23 Mar 2022 10:26 |
Last Modified: | 23 Mar 2022 10:26 |
Status: | Published |
Publisher: | Public Library of Science (PLoS) |
Refereed: | Yes |
Identification Number: | 10.1371/journal.pone.0265312 |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:185003 |