Marsden, Emma Josephine orcid.org/0000-0003-4086-5765, Morgan-Short, Kara, Thompson, Sophie et al. (1 more author) (2018) Replication in second language research:Narrative and systematic reviews, and recommendations for the field. Language Learning. pp. 321-391. ISSN 0023-8333
Abstract
Despite its critical role for the development of the field, little is known about replication in second language (L2) research. To better understand replication practice, we first provide a narrative review of challenges related to replication, drawing on recent developments in psychology. This discussion frames and motivates a systematic review, building on syntheses of replication in psychology, education, and L2 research. We coded 67 self-labeled L2 replication studies found across 26 journals for 136 characteristics. We estimated a mean rate of 1 published replication study for every 400 articles, with a mean of 6.64 years between initial and replication studies and a mean of 117 citations of the initial study before a replication was published. Replication studies had an annual mean of 7.3 citations, much higher than averages in linguistics and education. Overlap in authorship between initial and replication studies and the availability of the initial materials both increased the likelihood of a replication supporting the initial findings. Our sample contained no direct (exact) replication attempts, and changes made to initial studies were numerous and wide ranging, which likely obscured, if not undermined, the interpretability of replication studies. To improve the amount and quality of L2 replication research, we propose 16 recommendations relating to rationale, nomenclature, design, infrastructure, and incentivization for collaboration and publication.
Metadata
Item Type: | Article |
---|---|
Authors/Creators: |
|
Copyright, Publisher and Additional Information: | © 2018 The Authors. |
Keywords: | methodology,publishing,replication,research design,second language,systematic review |
Dates: |
|
Institution: | The University of York |
Academic Units: | The University of York > Faculty of Social Sciences (York) > Education (York) The University of York > Faculty of Arts and Humanities (York) > Language and Linguistic Science (York) |
Funding Information: | Funder Grant number ECONOMIC AND SOCIAL RESEARCH COUNCIL (ESRC) ES/I015647/1 |
Depositing User: | Pure (York) |
Date Deposited: | 15 Feb 2018 12:40 |
Last Modified: | 08 Feb 2025 00:24 |
Published Version: | https://doi.org/10.1111/lang.12286 |
Status: | Published |
Refereed: | Yes |
Identification Number: | 10.1111/lang.12286 |
Related URLs: | |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:127564 |
Downloads
Filename: Marsden_et_al._LL_synthesis_of_replication_research_accepted_pre_print_4_Dec_2017.pdf
Description: Marsden et al._LL_synthesis of replication research_accepted pre-print_4 Dec 2017
Filename: Marsden_et_al_2018_LL_Replic_synthesis_and_recommendations_FINAL_PUBLISHED_VERSION_.pdf
Description: Marsden et al 2018 LL Replic synthesis and recommendations_FINAL PUBLISHED VERSION
Licence: CC-BY 2.5