McDougle, SD, Butcher, PA, Parvin, D et al. (4 more authors) (2019) Neural Signatures of Prediction Errors in a Decision-Making Task are Modulated by Action Execution Failures. Current Biology, 29 (10). 1606-1613.e5. ISSN 0960-9822
Abstract
Decisions must be implemented through actions, and actions are prone to error. As such, when an expected outcome is not obtained, an individual should be sensitive to not only whether the choice itself was suboptimal but also whether the action required to indicate that choice was executed successfully. The intelligent assignment of credit to action execution versus action selection has clear ecological utility for the learner. To explore this, we used a modified version of a classic reinforcement learning task in which feedback indicated whether negative prediction errors were, or were not, associated with execution errors. Using fMRI, we asked if prediction error computations in the human striatum, a key substrate in reinforcement learning and decision making, are modulated when a failure in action execution results in the negative outcome. Participants were more tolerant of non-rewarded outcomes when these resulted from execution errors versus when execution was successful, but reward was withheld. Consistent with this behavior, a model-driven analysis of neural activity revealed an attenuation of the signal associated with negative reward prediction errors in the striatum following execution failures. These results converge with other lines of evidence suggesting that prediction errors in the mesostriatal dopamine system integrate high-level information during the evaluation of instantaneous reward outcomes.
Metadata
Item Type: | Article |
---|---|
Authors/Creators: |
|
Copyright, Publisher and Additional Information: | © 2019, Elsevier Ltd. This is an author produced version of an article published in Current Biology. Uploaded in accordance with the publisher's self-archiving policy. |
Keywords: | decision-making; reinforcement learning; striatum; error; reaching |
Dates: |
|
Institution: | The University of Leeds |
Academic Units: | The University of Leeds > Faculty of Medicine and Health (Leeds) > School of Psychology (Leeds) |
Funding Information: | Funder Grant number Experimental Psychology Society NO EXT REF GIVEN Wellcome Trust None given EPSRC EP/R031193/1 |
Depositing User: | Symplectic Publications |
Date Deposited: | 08 Apr 2019 10:48 |
Last Modified: | 02 May 2020 00:38 |
Status: | Published |
Publisher: | Cell Press |
Identification Number: | 10.1016/j.cub.2019.04.011 |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:144610 |