Neural Signatures of Prediction Errors in a Decision-Making Task Are Modulated by Action Execution Failures.


Journal

Current biology : CB
ISSN: 1879-0445
Titre abrégé: Curr Biol
Pays: England
ID NLM: 9107782

Informations de publication

Date de publication:
20 05 2019
Historique:
received: 19 11 2018
revised: 04 03 2019
accepted: 04 04 2019
pubmed: 6 5 2019
medline: 17 6 2020
entrez: 7 5 2019
Statut: ppublish

Résumé

Decisions must be implemented through actions, and actions are prone to error. As such, when an expected outcome is not obtained, an individual should be sensitive to not only whether the choice itself was suboptimal but also whether the action required to indicate that choice was executed successfully. The intelligent assignment of credit to action execution versus action selection has clear ecological utility for the learner. To explore this, we used a modified version of a classic reinforcement learning task in which feedback indicated whether negative prediction errors were, or were not, associated with execution errors. Using fMRI, we asked if prediction error computations in the human striatum, a key substrate in reinforcement learning and decision making, are modulated when a failure in action execution results in the negative outcome. Participants were more tolerant of non-rewarded outcomes when these resulted from execution errors versus when execution was successful, but reward was withheld. Consistent with this behavior, a model-driven analysis of neural activity revealed an attenuation of the signal associated with negative reward prediction errors in the striatum following execution failures. These results converge with other lines of evidence suggesting that prediction errors in the mesostriatal dopamine system integrate high-level information during the evaluation of instantaneous reward outcomes.

Identifiants

pubmed: 31056386
pii: S0960-9822(19)30409-9
doi: 10.1016/j.cub.2019.04.011
pmc: PMC6535105
mid: NIHMS1527338
pii:
doi:

Types de publication

Journal Article Research Support, N.I.H., Extramural

Langues

eng

Sous-ensembles de citation

IM

Pagination

1606-1613.e5

Subventions

Organisme : NINDS NIH HHS
ID : R01 NS084948
Pays : United States
Organisme : NINDS NIH HHS
ID : R01 NS092079
Pays : United States

Informations de copyright

Copyright © 2019 Elsevier Ltd. All rights reserved.

Références

PLoS Comput Biol. 2013;9(7):e1003150
pubmed: 23935472
J Neurosci. 2017 Apr 19;37(16):4332-4342
pubmed: 28320846
Nature. 2006 Jun 15;441(7095):876-9
pubmed: 16778890
J Neurophysiol. 2009 Sep;102(3):1868-79
pubmed: 19605614
Neuron. 2012 Jun 7;74(5):947-60
pubmed: 22681697
Neuron. 2011 Jul 28;71(2):370-9
pubmed: 21791294
Neuroimage. 2015 May 15;112:278-287
pubmed: 25770990
J Neurosci. 2018 May 9;38(19):4521-4530
pubmed: 29650698
Psychon Bull Rev. 2004 Feb;11(1):192-6
pubmed: 15117008
Nat Commun. 2017 Jun 27;8:15958
pubmed: 28653668
Neuropsychologia. 1971 Mar;9(1):97-113
pubmed: 5146491
Trends Cogn Sci. 2013 May;17(5):241-54
pubmed: 23579055
Proc Natl Acad Sci U S A. 2010 Sep 14;107(37):16401-6
pubmed: 20805507
Proc Natl Acad Sci U S A. 2016 Jun 14;113(24):6797-802
pubmed: 27247404
Curr Opin Neurobiol. 2018 Apr;49:1-7
pubmed: 29096115
Adv Exp Med Biol. 2013;782:39-60
pubmed: 23296480
Neuroimage. 2008 Feb 1;39(3):1383-95
pubmed: 18032069
Physiol Rev. 2015 Jul;95(3):853-951
pubmed: 26109341
J Neurosci. 2014 Nov 5;34(45):14901-12
pubmed: 25378157
J Neurosci. 1996 Mar 1;16(5):1936-47
pubmed: 8774460
J Neurosci. 2015 Nov 18;35(46):15369-78
pubmed: 26586823
J Neurosci. 2014 Oct 8;34(41):13747-56
pubmed: 25297101
Psychopharmacology (Berl). 2007 Apr;191(3):507-20
pubmed: 17031711
Neuron. 2011 Mar 24;69(6):1204-15
pubmed: 21435563
J Neurosci. 2005 Oct 26;25(43):9919-31
pubmed: 16251440
Spat Vis. 1997;10(4):433-6
pubmed: 9176952
Neuron. 2017 Jan 18;93(2):451-463
pubmed: 28103483
J Neurosci. 2014 Feb 19;34(8):3023-32
pubmed: 24553942
Neuroscientist. 2004 Jun;10(3):260-8
pubmed: 15155064
Psychon Bull Rev. 2015 Oct;22(5):1320-7
pubmed: 25582684
J Neurosci. 2012 Jan 11;32(2):551-62
pubmed: 22238090
J Neurophysiol. 2004 Feb;91(2):924-33
pubmed: 14523069
Science. 1997 Mar 14;275(5306):1593-9
pubmed: 9054347

Auteurs

Samuel D McDougle (SD)

Department of Psychology, University of California, Berkeley, 2121 Berkeley Way, Berkeley, CA 94704, USA. Electronic address: mcdougle@berkeley.edu.

Peter A Butcher (PA)

Department of Psychology, Princeton University, South Drive, Princeton, NJ 08540, USA.

Darius E Parvin (DE)

Department of Psychology, University of California, Berkeley, 2121 Berkeley Way, Berkeley, CA 94704, USA.

Fasial Mushtaq (F)

School of Psychology, University of Leeds, 4 Lifton Pl., Leeds LS2 9JZ, UK.

Yael Niv (Y)

Department of Psychology, Princeton University, South Drive, Princeton, NJ 08540, USA; Princeton Neuroscience Institute, Princeton University, South Drive, Princeton, NJ 08540, USA.

Richard B Ivry (RB)

Department of Psychology, University of California, Berkeley, 2121 Berkeley Way, Berkeley, CA 94704, USA; Helen Wills Neuroscience Institute, University of California, Berkeley, Li Ka Shing Center, Berkeley, CA 94720, USA.

Jordan A Taylor (JA)

Department of Psychology, Princeton University, South Drive, Princeton, NJ 08540, USA; Princeton Neuroscience Institute, Princeton University, South Drive, Princeton, NJ 08540, USA.

Articles similaires

[Redispensing of expensive oral anticancer medicines: a practical application].

Lisanne N van Merendonk, Kübra Akgöl, Bastiaan Nuijen
1.00
Humans Antineoplastic Agents Administration, Oral Drug Costs Counterfeit Drugs

Smoking Cessation and Incident Cardiovascular Disease.

Jun Hwan Cho, Seung Yong Shin, Hoseob Kim et al.
1.00
Humans Male Smoking Cessation Cardiovascular Diseases Female
Humans United States Aged Cross-Sectional Studies Medicare Part C
1.00
Humans Yoga Low Back Pain Female Male

Classifications MeSH