Leppink, Jimmie orcid.org/0000-0002-8713-1374 and Pérez-Fuster, Patricia (2017) We need more replication research – A case for test-retest reliability. Perspectives on Medical Education. pp. 158-164. ISSN 2212-2761
Abstract
Following debates in psychology on the importance of replication research, we have also started to see pleas for a more prominent role for replication research in medical education. To enable replication research, it is of paramount importance to carefully study the reliability of the instruments we use. Cronbach’s alpha has been the most widely used estimator of reliability in the field of medical education, notably as some kind of quality label of test or questionnaire scores based on multiple items or of the reliability of assessment across exam stations. However, as this narrative review outlines, Cronbach’s alpha or alternative reliability statistics may complement but not replace psychometric methods such as factor analysis. Moreover, multiple-item measurements should be preferred above single-item measurements, and when using single-item measurements, coefficients as Cronbach’s alpha should not be interpreted as indicators of the reliability of a single item when that item is administered after fundamentally different activities, such as learning tasks that differ in content. Finally, if we want to follow up on recent pleas for more replication research, we have to start studying the test-retest reliability of the instruments we use.
Metadata
Item Type: | Article |
---|---|
Authors/Creators: |
|
Copyright, Publisher and Additional Information: | © The Author(s) 2017. |
Keywords: | Cronbach’s alpha,Factor analysis,Medical education,Multilevel analysis,Test-retest reliability |
Dates: |
|
Institution: | The University of York |
Academic Units: | The University of York > Faculty of Sciences (York) > Hull York Medical School (York) |
Depositing User: | Pure (York) |
Date Deposited: | 15 Aug 2019 09:40 |
Last Modified: | 23 Jan 2025 00:20 |
Published Version: | https://doi.org/10.1007/s40037-017-0347-z |
Status: | Published |
Refereed: | Yes |
Identification Number: | 10.1007/s40037-017-0347-z |
Related URLs: | |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:149752 |
Download
Filename: Leppink_P_rez_Fuster2017_Article_WeNeedMoreReplicationResearchA.pdf
Description: We need more replication research – A case for test-retest reliability
Licence: CC-BY 2.5