Flint, AE, Waterman, MG orcid.org/0000-0003-0168-0426, Siddell, P et al. (4 more authors) (2019) Assessing evidence quality in research reporting neurocognitive outcomes following paediatric temporal lobe surgery for epilepsy. Epilepsy Research, 154. pp. 116-123. ISSN 0920-1211
Abstract
Purpose: RCTs are the gold standard in determining intervention efficacy with journal impact factor assumed to index research quality. Flint et al’s (2017) systematic review examined neurocognitive outcomes following paediatric temporal lobe epilepsy surgery. Retrieved evidence was restricted to non-RCTs, which pose greater risk of bias and thus diminish research quality. The current study evaluated risk of bias in sources retrieved by Flint et al. and explored whether impact factor related to research quality within this selected field.
Methods: Methodological and reporting bias was evaluated using categories of bias specified by Cochrane. The relationship between the identified number of biases and journal impact factors of retrieved sources was examined.
Results: All studies carried substantial risk for bias. Methodology bias included low sample size (76.71%; 56/73), risk of confounding cognitive outcomes due to failure to report pre-surgery neurocognitive data (21.92%; 16/73) and to determine whether patients were prescribed antiepileptic drugs at follow-up (53.42%; 39/73). Reporting bias included overstating claims based on findings (53.42%; 39/73), failure to report individual patient characteristics (66%; 33/50) and omitting the nature of surgical interventions (15.07%; 11/73). The number of sources of common bias within studies was not associated significantly with journal impact factor (p = .878).
Conclusion: This evaluation highlights risk of bias when sources are predominantly uncontrolled non-RCTs and provides evidence that journal impact factor is not a reliable indicator of quality within this field. Authors should limit bias in their methods and reporting of results, to ensure the highest quality evidence possible is used to inform treatment decisions and prognosis.
Metadata
Item Type: | Article |
---|---|
Authors/Creators: |
|
Copyright, Publisher and Additional Information: | © 2019 Elsevier B.V. All rights reserved. This is an author produced version of a paper published in Epilepsy Research. Uploaded in accordance with the publisher's self-archiving policy. |
Keywords: | Research quality; Bias; Pediatric epilepsy surgery; Cognitive |
Dates: |
|
Institution: | The University of Leeds |
Academic Units: | The University of Leeds > Faculty of Medicine and Health (Leeds) > School of Psychology (Leeds) |
Depositing User: | Symplectic Publications |
Date Deposited: | 16 Aug 2019 08:26 |
Last Modified: | 30 Mar 2020 00:41 |
Status: | Published |
Publisher: | Elsevier |
Identification Number: | 10.1016/j.eplepsyres.2019.03.013 |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:149605 |