Munthe‐Kaas, H.M. orcid.org/0000-0002-6051-9010, Booth, A. orcid.org/0000-0003-4808-3880, Sommer, I. orcid.org/0000-0003-3592-1507 et al. (4 more authors) (2024) Developing CAMELOT for assessing methodological limitations of qualitative research for inclusion in qualitative evidence syntheses. Cochrane Evidence Synthesis and Methods, 2 (6). e12058. ISSN 2832-9023
Abstract
Introduction
Qualitative evidence is increasingly incorporated into decision-making processes. Assessing the methodological limitations of primary studies is critical to making an overall assessment of confidence in findings from qualitative evidence syntheses (QES) using GRADE-CERQual. Current critical appraisal tools were not developed specifically for use in Cochrane reviews or GRADE-CERQual, and few are evidence-based. The aim of CochrAne qualitative Methodological LimitatiOns Tool (CAMELOT) was to address this gap.
Methods
We undertook this project in four stages: (1) systematic literature search to identify existing tools, (2) identification of evidence to support inclusion of potential CAMELOT domains (3) consensus survey to agree on the inclusion and definition of CAMELOT domains, and (4) human-centered design approach to develop and refine CAMELOT by exploring user experience.
Results
CAMELOT is a new evidence-based tool for assessing the methodological strengths and limitations of primary qualitative research studies in a QES. CAMELOT is comprised of 12 domains: four Meta domains that encourage review authors to consider those characteristics of the primary study that are beyond how the study was carried out, but which inform the conduct and design of the study, and eight Method domains which encourage review authors to consider how the study was designed, planned and/or conducted, and how study conduct and design fits with the information provided in the four meta domains. Review authors make an assessment by identifying any concerns regarding the methods used in the study and considering the appropriateness of fit between the Meta and Method domains.
Conclusion
CAMELOT provides review authors with a transparent and systematic method to assess methodological limitations of primary qualitative studies. CAMELOT incorporates qualitative principles and focuses on appropriateness of fit between Meta and Method domains. In line with iterative tool development approach, CAMELOT will continue to be revised over time following extensive user testing and piloting.
Metadata
Item Type: | Article |
---|---|
Authors/Creators: |
|
Copyright, Publisher and Additional Information: | © 2024 The Author(s). Cochrane Evidence Synthesis and Methods published by John Wiley & Sons Ltd on behalf of The Cochrane Collaboration. This is an open access article under the terms of the Creative Commons Attribution‐NonCommercial‐NoDerivs License (http://creativecommons.org/licenses/by-nc-nd/4.0/), which permits use and distribution in any medium, provided the original work is properly cited, the use is non‐commercial and no modifications or adaptations are made |
Keywords: | consensus development; critical appraisal; Delphi; GRADE‐CERQual; methodological limitations; qualitative evidence synthesis; qualitative research |
Dates: |
|
Institution: | The University of Sheffield |
Academic Units: | The University of Sheffield > Faculty of Medicine, Dentistry and Health (Sheffield) > School of Medicine and Population Health |
Depositing User: | Symplectic Sheffield |
Date Deposited: | 17 Jun 2024 14:57 |
Last Modified: | 17 Jun 2024 14:57 |
Status: | Published |
Publisher: | Wiley |
Refereed: | Yes |
Identification Number: | 10.1002/cesm.12058 |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:213353 |