Neural Signatures of Prediction Errors in a Decision-Making Task Are Modulated by Action Execution Failures.
decision making
error
reaching
reinforcement learning
striatum
Journal
Current biology : CB
ISSN: 1879-0445
Titre abrégé: Curr Biol
Pays: England
ID NLM: 9107782
Informations de publication
Date de publication:
20 05 2019
20 05 2019
Historique:
received:
19
11
2018
revised:
04
03
2019
accepted:
04
04
2019
pubmed:
6
5
2019
medline:
17
6
2020
entrez:
7
5
2019
Statut:
ppublish
Résumé
Decisions must be implemented through actions, and actions are prone to error. As such, when an expected outcome is not obtained, an individual should be sensitive to not only whether the choice itself was suboptimal but also whether the action required to indicate that choice was executed successfully. The intelligent assignment of credit to action execution versus action selection has clear ecological utility for the learner. To explore this, we used a modified version of a classic reinforcement learning task in which feedback indicated whether negative prediction errors were, or were not, associated with execution errors. Using fMRI, we asked if prediction error computations in the human striatum, a key substrate in reinforcement learning and decision making, are modulated when a failure in action execution results in the negative outcome. Participants were more tolerant of non-rewarded outcomes when these resulted from execution errors versus when execution was successful, but reward was withheld. Consistent with this behavior, a model-driven analysis of neural activity revealed an attenuation of the signal associated with negative reward prediction errors in the striatum following execution failures. These results converge with other lines of evidence suggesting that prediction errors in the mesostriatal dopamine system integrate high-level information during the evaluation of instantaneous reward outcomes.
Identifiants
pubmed: 31056386
pii: S0960-9822(19)30409-9
doi: 10.1016/j.cub.2019.04.011
pmc: PMC6535105
mid: NIHMS1527338
pii:
doi:
Types de publication
Journal Article
Research Support, N.I.H., Extramural
Langues
eng
Sous-ensembles de citation
IM
Pagination
1606-1613.e5Subventions
Organisme : NINDS NIH HHS
ID : R01 NS084948
Pays : United States
Organisme : NINDS NIH HHS
ID : R01 NS092079
Pays : United States
Informations de copyright
Copyright © 2019 Elsevier Ltd. All rights reserved.
Références
PLoS Comput Biol. 2013;9(7):e1003150
pubmed: 23935472
J Neurosci. 2017 Apr 19;37(16):4332-4342
pubmed: 28320846
Nature. 2006 Jun 15;441(7095):876-9
pubmed: 16778890
J Neurophysiol. 2009 Sep;102(3):1868-79
pubmed: 19605614
Neuron. 2012 Jun 7;74(5):947-60
pubmed: 22681697
Neuron. 2011 Jul 28;71(2):370-9
pubmed: 21791294
Neuroimage. 2015 May 15;112:278-287
pubmed: 25770990
J Neurosci. 2018 May 9;38(19):4521-4530
pubmed: 29650698
Psychon Bull Rev. 2004 Feb;11(1):192-6
pubmed: 15117008
Nat Commun. 2017 Jun 27;8:15958
pubmed: 28653668
Neuropsychologia. 1971 Mar;9(1):97-113
pubmed: 5146491
Trends Cogn Sci. 2013 May;17(5):241-54
pubmed: 23579055
Proc Natl Acad Sci U S A. 2010 Sep 14;107(37):16401-6
pubmed: 20805507
Proc Natl Acad Sci U S A. 2016 Jun 14;113(24):6797-802
pubmed: 27247404
Curr Opin Neurobiol. 2018 Apr;49:1-7
pubmed: 29096115
Adv Exp Med Biol. 2013;782:39-60
pubmed: 23296480
Neuroimage. 2008 Feb 1;39(3):1383-95
pubmed: 18032069
Physiol Rev. 2015 Jul;95(3):853-951
pubmed: 26109341
J Neurosci. 2014 Nov 5;34(45):14901-12
pubmed: 25378157
J Neurosci. 1996 Mar 1;16(5):1936-47
pubmed: 8774460
J Neurosci. 2015 Nov 18;35(46):15369-78
pubmed: 26586823
J Neurosci. 2014 Oct 8;34(41):13747-56
pubmed: 25297101
Psychopharmacology (Berl). 2007 Apr;191(3):507-20
pubmed: 17031711
Neuron. 2011 Mar 24;69(6):1204-15
pubmed: 21435563
J Neurosci. 2005 Oct 26;25(43):9919-31
pubmed: 16251440
Spat Vis. 1997;10(4):433-6
pubmed: 9176952
Neuron. 2017 Jan 18;93(2):451-463
pubmed: 28103483
J Neurosci. 2014 Feb 19;34(8):3023-32
pubmed: 24553942
Neuroscientist. 2004 Jun;10(3):260-8
pubmed: 15155064
Psychon Bull Rev. 2015 Oct;22(5):1320-7
pubmed: 25582684
J Neurosci. 2012 Jan 11;32(2):551-62
pubmed: 22238090
J Neurophysiol. 2004 Feb;91(2):924-33
pubmed: 14523069
Science. 1997 Mar 14;275(5306):1593-9
pubmed: 9054347