Dopaminergic modulation of the exploration/exploitation trade-off in human decision-making.


Journal

eLife
ISSN: 2050-084X
Titre abrégé: Elife
Pays: England
ID NLM: 101579614

Informations de publication

Date de publication:
02 06 2020
Historique:
received: 21 08 2019
accepted: 01 05 2020
entrez: 3 6 2020
pubmed: 3 6 2020
medline: 23 2 2021
Statut: epublish

Résumé

Involvement of dopamine in regulating exploration during decision-making has long been hypothesized, but direct causal evidence in humans is still lacking. Here, we use a combination of computational modeling, pharmacological intervention and functional magnetic resonance imaging to address this issue. Thirty-one healthy male participants performed a restless four-armed bandit task in a within-subjects design under three drug conditions: 150 mg of the dopamine precursor L-dopa, 2 mg of the D2 receptor antagonist haloperidol, and placebo. Choices were best explained by an extension of an established Bayesian learning model accounting for perseveration, directed exploration and random exploration. Modeling revealed attenuated directed exploration under L-dopa, while neural signatures of exploration, exploitation and prediction error were unaffected. Instead, L-dopa attenuated neural representations of overall uncertainty in insula and dorsal anterior cingulate cortex. Our results highlight the computational role of these regions in exploration and suggest that dopamine modulates how this circuit tracks accumulating uncertainty during decision-making.

Identifiants

pubmed: 32484779
doi: 10.7554/eLife.51260
pii: 51260
pmc: PMC7266623
doi:
pii:

Substances chimiques

Levodopa 46627O600J
Haloperidol J6292F8L3D
Dopamine VTD58H1Z2X

Types de publication

Journal Article Research Support, Non-U.S. Gov't

Langues

eng

Sous-ensembles de citation

IM

Subventions

Organisme : Deutsche Forschungsgemeinschaft
ID : PE1627/5-1
Pays : International

Informations de copyright

© 2020, Chakroun et al.

Déclaration de conflit d'intérêts

KC, DM, AW, FG, JP No competing interests declared

Références

Spat Vis. 1997;10(4):433-6
pubmed: 9176952
J Neurosci. 2011 Feb 2;31(5):1606-13
pubmed: 21289169
Clin Ther. 2011 Apr;33(4):500-10
pubmed: 21635995
Nat Rev Neurosci. 2015 Jan;16(1):55-61
pubmed: 25406711
J Neurosci. 2015 Oct 28;35(43):14544-56
pubmed: 26511245
Neurobiol Aging. 2008 Feb;29(2):267-79
pubmed: 17098331
Physiol Rev. 1989 Jul;69(3):864-989
pubmed: 2568648
Neuropsychopharmacology. 2010 Jan;35(1):4-26
pubmed: 19812543
J Theor Biol. 2013 Apr 21;323:49-56
pubmed: 23380232
Philos Trans R Soc Lond B Biol Sci. 2008 Dec 12;363(1511):3801-11
pubmed: 18829433
Neuropsychologia. 2003;41(8):1020-7
pubmed: 12667537
Behav Neurosci. 2014 Oct;128(5):556-66
pubmed: 24911320
J Cogn Neurosci. 2012 Sep;24(9):1932-40
pubmed: 22663253
Trends Cogn Sci. 2009 Aug;13(8):334-40
pubmed: 19643659
Curr Opin Neurobiol. 2004 Dec;14(6):769-76
pubmed: 15582382
Neurosci Biobehav Rev. 2016 Dec;71:58-82
pubmed: 27555290
J Neurosci. 2010 Jun 30;30(26):8888-96
pubmed: 20592211
Nat Rev Neurosci. 2013 May;14(5):365-76
pubmed: 23571845
Curr Biol. 2009 Sep 29;19(18):1532-7
pubmed: 19733074
Neuropharmacology. 2014 Sep;84:159-69
pubmed: 23851258
Nat Commun. 2018 Jul 19;9(1):2822
pubmed: 30026489
Proc Natl Acad Sci U S A. 2011 Sep 13;108 Suppl 3:15647-54
pubmed: 21389268
eNeuro. 2017 Sep 18;4(5):
pubmed: 28929131
Behav Brain Funct. 2010 Apr 23;6:24
pubmed: 20416052
Front Neurosci. 2014 Jan 24;8:4
pubmed: 24478624
Science. 2009 May 22;324(5930):1080-4
pubmed: 19389999
J Exp Psychol Gen. 2004 Jun;133(2):189-217
pubmed: 15149250
Neuron. 2013 Jul 24;79(2):217-40
pubmed: 23889930
Soc Cogn Affect Neurosci. 2014 Sep;9(9):1289-302
pubmed: 23887811
Trends Cogn Sci. 2018 Feb;22(2):170-188
pubmed: 29229206
Neuron. 2019 Aug 7;103(3):533-545.e5
pubmed: 31196672
Neuroimage. 2010 Apr 1;50(2):709-16
pubmed: 20045470
Psychiatry Res. 2014 Dec 30;224(3):254-61
pubmed: 25453166
Neuroscience. 2014 Dec 12;282:13-22
pubmed: 24463000
Nat Neurosci. 2005 May;8(5):594-6
pubmed: 15821730
Front Behav Neurosci. 2010 Nov 04;4:170
pubmed: 21120145
Nature. 2006 Aug 31;442(7106):1042-5
pubmed: 16929307
Neurobiol Learn Mem. 2015 Sep;123:84-91
pubmed: 26004676
Nature. 2006 Jun 15;441(7095):876-9
pubmed: 16778890
Science. 2012 Apr 6;336(6077):95-8
pubmed: 22491854
J Comp Neurol. 2005 Dec 5;493(1):154-66
pubmed: 16254997
J Neurosci. 2008 Jul 30;28(31):7837-46
pubmed: 18667616
J Neurosci. 2014 Oct 22;34(43):14443-54
pubmed: 25339755
J Neurosci. 2018 Oct 10;38(41):8822-8830
pubmed: 30181136
Curr Opin Neurobiol. 2012 Dec;22(6):1027-38
pubmed: 22766486
J Exp Psychol Gen. 2014 Dec;143(6):2074-81
pubmed: 25347535
J Neurosci. 2009 Oct 7;29(40):12574-83
pubmed: 19812332
J Neurosci. 2009 Dec 2;29(48):15104-14
pubmed: 19955362
Nature. 2008 Jun 12;453(7197):879-84
pubmed: 18496528
Clin Neuropharmacol. 1987 Dec;10(6):527-37
pubmed: 3427559
Neuron. 2009 Jun 11;62(5):733-43
pubmed: 19524531
Neuron. 2015 Feb 18;85(4):874-85
pubmed: 25640078
Neuron. 2006 Feb 16;49(4):603-15
pubmed: 16476668
Cereb Cortex. 2012 Nov;22(11):2575-86
pubmed: 22120491
Dialogues Clin Neurosci. 2016 Mar;18(1):23-32
pubmed: 27069377
Cognition. 2018 Apr;173:34-42
pubmed: 29289795
Neuron. 2010 Mar 11;65(5):585-96
pubmed: 20223196
Prog Neurobiol. 2004 Apr;72(5):341-72
pubmed: 15157726
Memory. 2009 Aug;17(6):635-54
pubmed: 19536691
Nat Neurosci. 2006 Jul;9(7):940-7
pubmed: 16783368
Biol Psychiatry. 2011 Jun 15;69(12):e113-25
pubmed: 21531388
Horm Behav. 2015 Aug;74:125-38
pubmed: 26122294
Top Cogn Sci. 2015 Apr;7(2):351-67
pubmed: 25899069
Commun Biol. 2018 Jun 7;1:62
pubmed: 30271944
Brain Res Bull. 1995;37(3):295-9
pubmed: 7627573
Neuropsychopharmacology. 1994 Dec;11(4):245-56
pubmed: 7531978
Mem Cognit. 2015 Feb;43(2):226-36
pubmed: 25217113
Neuroimage. 2015 Apr 1;109:95-101
pubmed: 25562824
Front Hum Neurosci. 2016 Dec 22;10:651
pubmed: 28066217
Cogn Affect Behav Neurosci. 2005 Jun;5(2):212-21
pubmed: 16180627
Elife. 2017 Sep 15;6:
pubmed: 28914605
PLoS Biol. 2011 Jun;9(6):e1001093
pubmed: 21738446
J Neurosci. 2008 Mar 12;28(11):2745-52
pubmed: 18337404
J Neurochem. 2003 Oct;87(2):273-89
pubmed: 14511105
Proc Natl Acad Sci U S A. 2001 Jan 16;98(2):676-82
pubmed: 11209064
Neuropsychopharmacology. 2015 Jan;40(2):454-62
pubmed: 25074639
Front Neurosci. 2012 Oct 16;6:150
pubmed: 23087606
J Neurosci. 2000 Nov 15;20(22):8443-51
pubmed: 11069952
Psychophysiology. 2005 Jan;42(1):1-15
pubmed: 15720576
Behav Brain Res. 2010 Dec 1;213(2):135-41
pubmed: 20420859
Neuropsychopharmacology. 2017 Sep;42(10):1931-1939
pubmed: 28553839
Front Hum Neurosci. 2014 Jan 22;7:927
pubmed: 24478664
PLoS Biol. 2009 Jul;7(7):e1000164
pubmed: 19636360
Ann N Y Acad Sci. 2014 May;1316:29-52
pubmed: 24502540
Cereb Cortex. 2009 Feb;19(2):445-54
pubmed: 18550595
J Neurosci. 2005 Mar 30;25(13):3304-11
pubmed: 15800185
Nat Rev Neurosci. 2009 Jan;10(1):59-70
pubmed: 19096369
F1000Res. 2015 Jan 23;4:23
pubmed: 26180632
Cortex. 2017 Oct;95:222-237
pubmed: 28917135
Cogn Affect Behav Neurosci. 2018 Feb;18(1):117-126
pubmed: 29218570
Trends Cogn Sci. 2004 Dec;8(12):539-46
pubmed: 15556023
Neuroimage. 2013 Aug 1;76:412-27
pubmed: 23507394
Prog Brain Res. 2013;202:289-320
pubmed: 23317838
Neuropsychopharmacology. 2014 Sep;39(10):2366-75
pubmed: 24713613
Trends Neurosci. 2009 Jan;32(1):56-67
pubmed: 18986715
Behav Neurosci. 2006 Jun;120(3):497-517
pubmed: 16768602
Neuron. 2012 Feb 9;73(3):595-607
pubmed: 22325209
J Neurosci. 2007 Nov 21;27(47):12860-7
pubmed: 18032658
Cereb Cortex. 2015 Jan;25(1):236-45
pubmed: 23966584
Nat Neurosci. 2009 Aug;12(8):1062-8
pubmed: 19620978
Ann N Y Acad Sci. 2011 Dec;1239:118-29
pubmed: 22145881
Neuron. 2006 Aug 3;51(3):381-90
pubmed: 16880132
Neuropsychologia. 1971 Mar;9(1):97-113
pubmed: 5146491
J Chem Neuroanat. 2001 Jul;22(1-2):127-37
pubmed: 11470560
Mol Psychiatry. 2004 Dec;9(12):1060-1
pubmed: 15278099
Nat Neurosci. 2013 Jul;16(7):966-73
pubmed: 23708143
Neuron. 2009 Nov 12;64(3):431-9
pubmed: 19914190
Nat Neurosci. 2008 Apr;11(4):389-97
pubmed: 18368045
Science. 2004 Dec 10;306(5703):1940-3
pubmed: 15528409
Neuron. 2018 Jan 17;97(2):450-461.e9
pubmed: 29290550
Biol Psychiatry. 2006 May 15;59(10):898-907
pubmed: 16682268
Philos Trans R Soc Lond B Biol Sci. 2007 May 29;362(1481):933-42
pubmed: 17395573
Neuroimage. 2019 Feb 1;186:113-125
pubmed: 30381245
Neuroimage. 2001 Dec;14(6):1278-89
pubmed: 11707084
Nat Rev Neurosci. 2017 Nov;18(11):645-657
pubmed: 28951610
Proc Natl Acad Sci U S A. 2001 Feb 13;98(4):1982-7
pubmed: 11172062
Science. 2004 Feb 13;303(5660):1023-6
pubmed: 14963333
Neuropsychologia. 2018 Nov;120:97-104
pubmed: 30347192
Eur J Neurosci. 2018 May;47(9):1081-1086
pubmed: 29514419
Science. 1997 Mar 14;275(5306):1593-9
pubmed: 9054347
Neuroreport. 1997 Nov 10;8(16):3581-5
pubmed: 9427330
Psychopharmacology (Berl). 2006 Nov;188(4):567-85
pubmed: 16670842
Horm Behav. 2018 Aug;104:119-129
pubmed: 29626485
Front Psychol. 2013 Sep 30;4:640
pubmed: 24137137
Psychopharmacology (Berl). 2007 Apr;191(3):813-22
pubmed: 17279377
Neurosci Biobehav Rev. 2006;30(1):1-23
pubmed: 15935475
Nat Commun. 2014 Nov 04;5:5394
pubmed: 25367437
Nat Rev Neurosci. 2002 Aug;3(8):655-66
pubmed: 12154366
Neuroimage. 2018 Aug 15;177:88-97
pubmed: 29723641
J Neurosci. 2008 Jan 30;28(5):1208-12
pubmed: 18234898
Physiol Behav. 2002 Dec;77(4-5):477-82
pubmed: 12526986
Front Neurosci. 2013 Apr 19;7:62
pubmed: 23626521
Nat Rev Neurosci. 2012 Jul 11;13(8):572-86
pubmed: 22781958

Auteurs

Karima Chakroun (K)

Department of Systems Neuroscience, University Medical Center Hamburg-Eppendorf, Hamburg, Germany.

David Mathar (D)

Department of Psychology, Biological Psychology, University of Cologne, Cologne, Germany.

Antonius Wiehler (A)

Department of Systems Neuroscience, University Medical Center Hamburg-Eppendorf, Hamburg, Germany.
Institut du Cerveau et de la Moelle épinière - ICM, Centre de NeuroImagerie de Recherche - CENIR, Sorbonne Universités, Groupe Hospitalier Pitié-Salpêtrière, Paris, France.

Florian Ganzer (F)

German Center for Addiction Research in Childhood and Adolescence, University Medical Center Hamburg-Eppendorf, Hamburg, Germany.

Jan Peters (J)

Department of Systems Neuroscience, University Medical Center Hamburg-Eppendorf, Hamburg, Germany.
Department of Psychology, Biological Psychology, University of Cologne, Cologne, Germany.

Articles similaires

[Redispensing of expensive oral anticancer medicines: a practical application].

Lisanne N van Merendonk, Kübra Akgöl, Bastiaan Nuijen
1.00
Humans Antineoplastic Agents Administration, Oral Drug Costs Counterfeit Drugs

Smoking Cessation and Incident Cardiovascular Disease.

Jun Hwan Cho, Seung Yong Shin, Hoseob Kim et al.
1.00
Humans Male Smoking Cessation Cardiovascular Diseases Female
Humans United States Aged Cross-Sectional Studies Medicare Part C
1.00
Humans Yoga Low Back Pain Female Male

Classifications MeSH