Adams, Anne, Hart, Jennefer, Iacovides, Ioanna orcid.org/0000-0001-9674-8440 et al. (3 more authors) (2019) Co-created evaluation:Identifying how games support police learning. International Journal of Human Computer Studies. pp. 34-44. ISSN 1071-5819
Abstract
HCI often produces improved systems through co-creation with practitioners. However, evaluation methods are primarily researcher-led (i.e., not co-created with practitioners). As part of a games-based learning evaluation, we detail a novel co-creation method that produces evaluations on how technology influences learning. Based upon educational threshold concept theories, the Tricky Topic method supported the co-creation of knowledge-based evaluation questionnaires with trainers. The evaluation involved 116 new recruit police officers from three UK police forces who participated in a randomized-control trial. The Tricky Topic method provided insights of how the game significantly increased understanding p< .001 (moderate effect size) in comparison with face-to-face training. Tricky topic breakdowns identify increased tacit understanding (e.g., empathy, attention) after games training, and decreased tacit understanding (e.g., respect) after face-to face training. Finally, further research opportunities are discussed concerning co-created evaluation for valid and relevant deconstruction of participants’ understanding that allow designers to pinpoint systems-specific learning benefits.
Metadata
Item Type: | Article |
---|---|
Authors/Creators: |
|
Copyright, Publisher and Additional Information: | © 2019 Published by Elsevier Ltd. This is an author-produced version of the published paper. Uploaded in accordance with the publisher’s self-archiving policy. |
Keywords: | Evaluation,Police training,Serious games,Tricky Topics |
Dates: |
|
Institution: | The University of York |
Academic Units: | The University of York > Faculty of Sciences (York) > Computer Science (York) |
Depositing User: | Pure (York) |
Date Deposited: | 27 Mar 2019 09:51 |
Last Modified: | 21 Jan 2025 17:38 |
Published Version: | https://doi.org/10.1016/j.ijhcs.2019.03.009 |
Status: | Published |
Refereed: | Yes |
Identification Number: | 10.1016/j.ijhcs.2019.03.009 |
Related URLs: | |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:144158 |
Download
Filename: 1_s2.0_S1071581919300357_main.pdf
Description: Co-created Evaluation: identifying how games support police learning
Licence: CC-BY-NC-ND 2.5