Homer, MS orcid.org/0000-0002-1161-5938 and Pell, G (2009) The impact of the inclusion of simulated patient ratings on the reliability of OSCE assessments under the borderline regression method. Medical Teacher, 31 (5). pp. 420-425. ISSN 0142-159X
Abstract
Background
In Objective Structured Clinical Examinations (OSCEs), the use of simulated patients (SPs) at many stations is a key aspect of the assessment. Often the SPs are asked to provide formal feedback (ratings) of their experience with the students under examination.
Aims
This study analyses whether and how exactly SP data can be best used to enhance the robustness of the formal standard setting process.
Methods
A retrospective statistical investigation into the relationship between SP ratings and those provided by the clinical assessors (criterion-based checklist scores and overall grades for each station) is presented. In addition, the paper also includes a study into the impact of the inclusion of the SP ratings in the formal standard setting process for OSCEs, particularly when pass marks are calculated using the borderline regression method.
Results
The general results of the analysis, including discussion of two distinct methods for the combining of the SP ratings and assessor judgements, are presented, and demonstrate that the inclusion of this additional data can have important effects on individual student results.
Conclusion
It is possible for the overall quality of the OSCE assessment process to be improved, with increased reliability, by combining assessor checklist scores and SP ratings.
Metadata
Item Type: | Article |
---|---|
Authors/Creators: |
|
Copyright, Publisher and Additional Information: | (c) 2009, Informa Healthcare. This is an author produced version of a paper published in Medical Teacher. Uploaded in accordance with the publisher's self-archiving policy. |
Keywords: | Checklist; Clinical Competence; Education, Medical, Undergraduate; Educational Measurement; Humans; Patient Simulation; Retrospective Studies |
Dates: |
|
Institution: | The University of Leeds |
Academic Units: | The University of Leeds > Faculty of Education, Social Sciences and Law (Leeds) > School of Education (Leeds) The University of Leeds > Faculty of Medicine and Health (Leeds) > School of Medicine (Leeds) > Leeds Institute of Medical Education > Medical Education Unit (Leeds) |
Depositing User: | Symplectic Publications |
Date Deposited: | 06 Jun 2013 11:14 |
Last Modified: | 20 Sep 2018 17:30 |
Published Version: | http://dx.doi.org/10.1080/01421590802520949 |
Status: | Published |
Publisher: | Informa Healthcare |
Identification Number: | 10.1080/01421590802520949 |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:75620 |