Renaud, J-S, Bourget, M, St-Onge, C et al. (5 more authors) (Cover date: October 2022) Effect of station format on the psychometric properties of Multiple Mini Interviews. Medical Education, 56 (10). pp. 1042-1050. ISSN 0308-0110
Abstract
Background
Given the widespread use of Multiple Mini Interviews (MMIs), their impact on the selection of candidates and the considerable resources invested in preparing and administering them, it is essential to ensure their quality. Given the variety of station formats used and the degree to which that factor resides in the control of training programmes that we know so little about, format's effect on MMI quality is a considerable oversight. This study assessed the effect of two popular station formats (interview vs. role-play) on the psychometric properties of MMIs.
Methods
We analysed candidate data from the first 8 years of the Integrated French MMIs (IF-MMI) (2010–2017, n = 11 761 applicants), an MMI organised yearly by three francophone universities and administered at four testing sites located in two Canadian provinces. There were 84 role-play and 96 interview stations administered, totalling 180 stations. Mixed design analyses of variance (ANOVAs) were used to test the effect of station format on candidates' scores and stations' discrimination. Cronbach's alpha coefficients for interview and role-play stations were also compared. Predictive validity of both station formats was estimated with a mixed multiple linear regression model testing the relation between interview and role-play scores with average clerkship performance for those who gained entry to medical school (n = 462).
Results
Role-play stations (M = 20.67, standard deviation [SD] = 3.38) had a slightly lower mean score than interview stations (M = 21.36, SD = 3.08), p < 0.01, Cohen's d = 0.2. The correlation between role-play and interview stations scores was r = 0.5 (p < 0.01). Discrimination coefficients, Cronbach's alpha and predictive validity statistics did not vary by station format.
Conclusion
Interview and role-play stations have comparable psychometric properties, suggesting format to be interchangeable. Programmes should select station format based on match to the personal qualities for which they are trying to select.
Metadata
Item Type: | Article |
---|---|
Authors/Creators: |
|
Copyright, Publisher and Additional Information: | © 2022 Association for the Study of Medical Education and John Wiley & Sons Ltd. This is the peer reviewed version of the following article: Renaud, J-S, Bourget, M, St-Onge, C, et al. Effect of station format on the psychometric properties of Multiple Mini Interviews. Med Educ. 2022; 56( 10): 1042-1050, which has been published in final form at https://doi.org/10.1111/medu.14855. This article may be used for non-commercial purposes in accordance with Wiley Terms and Conditions for Use of Self-Archived Versions. This article may not be enhanced, enriched or otherwise transformed into a derivative work, without express permission from Wiley or by statutory rights under applicable legislation. Copyright notices must not be removed, obscured or modified. The article must be linked to Wiley’s version of record on Wiley Online Library and any embedding, framing or otherwise making available the article or pages thereof by third parties from platforms, services and websites other than Wiley Online Library must be prohibited. |
Dates: |
|
Institution: | The University of Leeds |
Academic Units: | The University of Leeds > Faculty of Education, Social Sciences and Law (Leeds) > School of Education (Leeds) |
Depositing User: | Symplectic Publications |
Date Deposited: | 10 Jun 2022 11:31 |
Last Modified: | 14 Jun 2023 00:13 |
Status: | Published |
Publisher: | Wiley |
Identification Number: | 10.1111/medu.14855 |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:187862 |