Using video-based situational judgment tests for teacher selection::A quasi-experiment exploring the relations between test format, subgroup differences, and applicant reactions

The question whether video-based situational judgment test (SJT) formats provide benefits over ‘traditional’ text-based SJTs has not yet been addressed in research on teacher selection. Focusing on three SJT conditions - two video-based conditions (with and without text), and a text-based condition - we investigated mean differences in applicant reactions and SJT scores, subgroup differences (ethnicity and gender), and relations between SJT scores and applicant reactions. Using a quasi-experimental design, 290 prospective teachers (56.6 % female) were randomly assigned to one of the three SJT conditions. SJT scores did not significantly differ between conditions, but both video-based formats were perceived as more engaging than the text-based format. Results from a multigroup path model indicated that there were gender effects for the text-based condition (females outperforming males), but not for the two video-based conditions. However, ethnicity bias (members from majority groups outperforming members from minority groups) occurred in all conditions. Differentiated patterns of relations were found between applicant reactions and SJT performance, with test anxiety significantly predicting SJT performance in the video with text condition and engagement significantly predicting SJT performance in the video without text condition. Implications for future research and teacher selection practice are discussed.