Janbesaraei, S.N., Rasanan, A.H.H., Nejati, V. et al. (1 more author) (2024) Do Human Reinforcement Learning Models Account for Key Experimental Choice Patterns in the Iowa Gambling Task? Computational Brain & Behavior. ISSN 2522-0861
Abstract
The Iowa gambling task (IGT) is widely used to study risky decision-making and learning from rewards and punishments. Although numerous cognitive models have been developed using reinforcement learning frameworks to investigate the processes underlying the IGT, no single model has consistently been identified as superior, largely due to the overlooked importance of model flexibility in capturing choice patterns. This study examines whether human reinforcement learning models adequately capture key experimental choice patterns observed in IGT data. Using simulation and parameter space partitioning (PSP) methods, we explored the parameter space of two recently introduced models—Outcome-Representation Learning and Value plus Sequential Exploration—alongside four traditional models. PSP, a global analysis method, investigates what patterns are relevant to the parameters’ spaces of a model, thereby providing insights into model flexibility. The PSP study revealed varying potentials among candidate models to generate relevant choice patterns in IGT, suggesting that model selection may be dependent on the specific choice patterns present in a given dataset. We investigated central choice patterns and fitted all models by analyzing a comprehensive data pool (N = 1428) comprising 45 behavioral datasets from both healthy and clinical populations. Applying Akaike and Bayesian information criteria, we found that the Value plus Sequential Exploration model outperformed others due to its balanced potential to generate all experimentally observed choice patterns. These findings suggested that the search for a suitable IGT model may have reached its conclusion, emphasizing the importance of aligning a model’s parameter space with experimentally observed choice patterns for achieving high accuracy in cognitive modeling.
Metadata
Item Type: | Article |
---|---|
Authors/Creators: |
|
Copyright, Publisher and Additional Information: | © Crown 2024. This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecomm ons.org/licenses/by/4.0/. |
Keywords: | Choice patterns, Cognitive modeling, Iowa gambling task, Model comparison, Parameter space partitioning, Reinforcement learning, Risky decisions |
Dates: |
|
Institution: | The University of Leeds |
Academic Units: | The University of Leeds > Faculty of Environment (Leeds) > Institute for Transport Studies (Leeds) |
Depositing User: | Symplectic Publications |
Date Deposited: | 16 Apr 2025 08:52 |
Last Modified: | 16 Apr 2025 15:10 |
Published Version: | https://link.springer.com/article/10.1007/s42113-0... |
Status: | Published online |
Publisher: | Springer |
Identification Number: | 10.1007/s42113-024-00228-2 |
Related URLs: | |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:225536 |
Download
Filename: Do Human Reinforcement Learning Models Account for Key.pdf
Licence: CC-BY 4.0