Willis, T. orcid.org/0000-0002-0252-9923, Wright-Hughes, A., Skinner, C. et al. (8 more authors) (2023) The detection and management of attempted fraud during an online randomised trial. Trials, 24. 494. ISSN 1745-6215
Abstract
Background
Online studies offer an efficient method of recruiting participants and collecting data. Whilst delivering an online randomised trial, we detected unusual recruitment activity. We describe our approach to detecting and managing suspected fraud and share lessons for researchers.
Methods
Our trial investigated the single and combined effects of different ways of presenting clinical audit and feedback. Clinicians and managers who received feedback from one of five United Kingdom national clinical audit programmes were emailed invitations that contained a link to the trial website. After providing consent and selecting their relevant audit, participants were randomised automatically to different feedback versions. Immediately after viewing their assigned feedback, participants completed a questionnaire and could request a financial voucher by entering an email address. Email addresses were not linked to trial data to preserve participant anonymity. We actively monitored participant numbers, questionnaire completions, and voucher claims.
Results
Following a rapid increase in trial participation, we identified 268 new voucher claims from three email addresses that we had reason to believe were linked. Further scrutiny revealed duplicate trial completions and voucher requests from 24 email addresses. We immediately suspended the trial, improved security measures, and went on to successfully complete the study.
We found a peak in questionnaires completed in less than 20 seconds during a likely contamination period. Given that study and personal data were not linked, we could not directly identify the trial data from the 268 duplicate entries within the 603 randomisations occurring during the same period. We therefore excluded all 603 randomisations from the primary analysis, which was consequently based on 638 randomisations. A sensitivity analysis, including all 961 randomisations over the entire study except for questionnaire completions of less than 20 seconds, found only minor differences from the primary analysis.
Conclusion
Online studies offering incentives for participation are at risk of attempted fraud. Systematic monitoring and analysis can help detect such activity. Measures to protect study integrity include linking participant identifiers to study data, balancing study security and ease of participation, and safeguarding the allocation of participant incentives.
Trial registration
International Standard Randomised Controlled Trial Number: ISRCTN41584028. Registration date is August 17, 2017.
Metadata
Item Type: | Article |
---|---|
Authors/Creators: |
|
Copyright, Publisher and Additional Information: | © The Author(s) 2023. This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http:// creativecommons.org/licenses/by/4. 0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/ zero/1. 0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data. |
Keywords: | Audit and feedback, Randomised fractional factorial experiment, Behaviour change, Trial misconduct, Online trial |
Dates: |
|
Institution: | The University of Leeds |
Academic Units: | The University of Leeds > Faculty of Medicine and Health (Leeds) > School of Medicine (Leeds) > Leeds Institute of Health Sciences (Leeds) > Academic Unit of Primary Care (Leeds) |
Depositing User: | Symplectic Publications |
Date Deposited: | 18 Jul 2023 10:13 |
Last Modified: | 13 Sep 2023 12:54 |
Published Version: | https://trialsjournal.biomedcentral.com/articles/1... |
Status: | Published |
Publisher: | BMC |
Identification Number: | 10.1186/s13063-023-07517-4 |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:201621 |
Download
Filename: The detection and management of attempted fraud during an online randomised trial .pdf
Licence: CC-BY 4.0