Patterson, Fiona, Cousans, Fran, Edwards, Helena et al. (3 more authors) (2017) The Predictive Validity of a Text-Based Situational Judgment Test in Undergraduate Medical and Dental School Admissions. Academic medicine : journal of the Association of American Medical Colleges. ISSN 1938-808X
Abstract
PROBLEM: Situational judgment tests (SJTs) can be used to assess the nonacademic attributes necessary for medical and dental trainees to become successful practitioners. Evidence for SJTs' predictive validity, however, relates predominantly to selection in postgraduate settings or using video-based SJTs at the undergraduate level; it may not be directly transferable to text-based SJTs in undergraduate medical and dental school selection. This preliminary study aimed to address these gaps by assessing the validity of the UK Clinical Aptitude Test (UKCAT) text-based SJT. APPROACH: Study participants were 218 first-year medical and dental students from four UK undergraduate schools who completed the first UKCAT text-based SJT in 2013. Outcome measures were educational supervisor ratings of in-role performance in problem-based learning tutorial sessions-mean rating across the three domains measured by the SJT (integrity, perspective taking, and team involvement) and an overall judgment of performance-collected in 2015. OUTCOMES: There were significant correlations between SJT scores and both mean supervisor ratings (uncorrected r = 0.24, P < .001; corrected r = 0.34) and overall judgments (uncorrected rs = 0.16, P < .05; corrected rs = 0.20). SJT scores predicted 6% of variance in mean supervisor ratings across the three nonacademic domains. NEXT STEPS: The results provide evidence that a well-designed text-based SJT can be appropriately integrated, and add value to, the selection process for undergraduate medical and dental school. More evidence is needed regarding the longitudinal predictive validity of SJTs throughout medical and dental training pathways, with appropriate outcome criteria.
Metadata
Item Type: | Article |
---|---|
Authors/Creators: |
|
Copyright, Publisher and Additional Information: | © 2017 by the Association of American Medical Colleges. This is an author-produced version of the published paper. Uploaded in accordance with the publisher’s self-archiving policy. Further copying may not be permitted; contact the publisher for details |
Keywords: | Journal Article |
Dates: |
|
Institution: | The University of York |
Academic Units: | The University of York > Faculty of Sciences (York) > Hull York Medical School (York) |
Depositing User: | Pure (York) |
Date Deposited: | 30 Mar 2017 09:20 |
Last Modified: | 16 Feb 2025 00:07 |
Published Version: | https://doi.org/10.1097/ACM.0000000000001630 |
Status: | Published |
Refereed: | Yes |
Identification Number: | 10.1097/ACM.0000000000001630 |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:114279 |
Download
Filename: The_Predictive_Validity_of_a_Text_Based.98258_1_.pdf
Description: The_Predictive_Validity_of_a_Text_Based.98258 (1)