Gundry, David Edward and Deterding, Christoph Sebastian orcid.org/0000-0003-0033-2104 (2019) Validity Threats in Quantitative Data Collection with Games:A Narrative Survey. Simulation & Gaming. pp. 302-328. ISSN 1046-8781
Abstract
Background. Games are increasingly used to collect scientific data. Some suggest that game features like high cognitive load may limit the inferences we can draw from such data, yet no systematic overview exists of potential validity threats of game-based methods. Aim. We present a narrative survey of documented and potential threats to validity in using games for quantitative data collection. Method. We combined an unsystematic bottom-up literature review with a systematic top-down application of standard validity threat typologies to games to arrive at a systematisation of game-characteristic validity threats. Results. We identify three game characteristics that potentially impact validity: Games are complex systems, impeding the predictable control and isolation of treatments. They are rich in unwanted variance and diversity. And their social framing can differ from and interact with the framing of research studies or non-game situations they are supposed to represent. The diversity of gamers and their differences to general populations bring further complications. Discussion and Conclusions. The wealth of potential validity threats in game-based research is met by a dearth of systematic methodological studies, leading us to outline several future research directions.
Metadata
Item Type: | Article |
---|---|
Authors/Creators: |
|
Copyright, Publisher and Additional Information: | © The Author(s) 2018. |
Keywords: | Data Collection,Game-based methods,Gamification,Games with a purpose,Serious Games,Validity,Validity threat,research gamification,applied games,data collection,validity threats,game-based methods,games with a purpose,validity |
Dates: |
|
Institution: | The University of York |
Academic Units: | The University of York > Faculty of Arts and Humanities (York) > Theatre, Film, TV and Interactive Media (York) The University of York > Faculty of Sciences (York) > Computer Science (York) |
Funding Information: | Funder Grant number EPSRC EP/M023265/1 EPSRC EP/L015846/1 |
Depositing User: | Pure (York) |
Date Deposited: | 08 Oct 2018 14:00 |
Last Modified: | 27 Nov 2024 00:33 |
Published Version: | https://doi.org/10.1177/1046878118805515 |
Status: | Published |
Refereed: | Yes |
Identification Number: | 10.1177/1046878118805515 |
Related URLs: | |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:136864 |
Downloads
Filename: Gundry_Deterding_Validity_Threats_Games.pdf
Description: Gundry_Deterding_Validity_Threats_Games
Filename: 1046878118805515.pdf
Description: Validity-Threats-Data-Collection-Survey
Licence: CC-BY 2.5