Variability in Action Selection Relates to Striatal Dopamine 2/3 Receptor Availability in Humans: A PET Neuroimaging Study Using Reinforcement Learning and Active Inference Models.
Adult
Bayes Theorem
Choice Behavior
/ physiology
Decision Making
/ physiology
Dopamine Agonists
Female
Humans
Learning
/ physiology
Male
Neostriatum
/ diagnostic imaging
Oxazines
Positron-Emission Tomography
Receptors, Dopamine D2
/ metabolism
Receptors, Dopamine D3
/ metabolism
Reinforcement, Psychology
Young Adult
action selection
active inference
decision temperature
dopamine 2/3 receptors
go no-go task
reinforcement learning
Journal
Cerebral cortex (New York, N.Y. : 1991)
ISSN: 1460-2199
Titre abrégé: Cereb Cortex
Pays: United States
ID NLM: 9110718
Informations de publication
Date de publication:
18 05 2020
18 05 2020
Historique:
received:
12
09
2019
revised:
18
11
2019
accepted:
05
12
2019
pubmed:
23
2
2020
medline:
21
12
2021
entrez:
22
2
2020
Statut:
ppublish
Résumé
Choosing actions that result in advantageous outcomes is a fundamental function of nervous systems. All computational decision-making models contain a mechanism that controls the variability of (or confidence in) action selection, but its neural implementation is unclear-especially in humans. We investigated this mechanism using two influential decision-making frameworks: active inference (AI) and reinforcement learning (RL). In AI, the precision (inverse variance) of beliefs about policies controls action selection variability-similar to decision 'noise' parameters in RL-and is thought to be encoded by striatal dopamine signaling. We tested this hypothesis by administering a 'go/no-go' task to 75 healthy participants, and measuring striatal dopamine 2/3 receptor (D2/3R) availability in a subset (n = 25) using [11C]-(+)-PHNO positron emission tomography. In behavioral model comparison, RL performed best across the whole group but AI performed best in participants performing above chance levels. Limbic striatal D2/3R availability had linear relationships with AI policy precision (P = 0.029) as well as with RL irreducible decision 'noise' (P = 0.020), and this relationship with D2/3R availability was confirmed with a 'decision stochasticity' factor that aggregated across both models (P = 0.0006). These findings are consistent with occupancy of inhibitory striatal D2/3Rs decreasing the variability of action selection in humans.
Identifiants
pubmed: 32083297
pii: 5741370
doi: 10.1093/cercor/bhz327
pmc: PMC7233027
doi:
Substances chimiques
DRD2 protein, human
0
DRD3 protein, human
0
Dopamine Agonists
0
Oxazines
0
Receptors, Dopamine D2
0
Receptors, Dopamine D3
0
naxagolide
22Z7E0X6OF
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
3573-3589Subventions
Organisme : Medical Research Council
ID : MR/N027078/1
Pays : United Kingdom
Organisme : Medical Research Council
ID : MR/L022176/1
Pays : United Kingdom
Organisme : Medical Research Council
ID : MC_U120097115
Pays : United Kingdom
Organisme : Medical Research Council
ID : G0700995
Pays : United Kingdom
Organisme : Medical Research Council
ID : MR/S007806/1
Pays : United Kingdom
Organisme : Medical Research Council
ID : MR/N026063/1
Pays : United Kingdom
Organisme : Wellcome Trust
ID : 095844/7/11/Z
Pays : United Kingdom
Organisme : Wellcome Trust
ID : 088130/Z/09/Z
Pays : United Kingdom
Organisme : Wellcome Trust
ID : 094849/Z/10/Z
Pays : United Kingdom
Informations de copyright
© The Author(s) 2020. Published by Oxford University Press.
Références
Psychol Rev. 1980 Nov;87(6):532-52
pubmed: 7443916
eNeuro. 2018 Oct 5;5(4):
pubmed: 30302389
Nature. 2006 Jun 15;441(7095):876-9
pubmed: 16778890
Neuroscientist. 2009 Dec;15(6):635-50
pubmed: 19793723
Biol Psychiatry. 2011 Jun 15;69(12):e113-25
pubmed: 21531388
Neuropsychopharmacology. 2009 Jul;34(8):2041-52
pubmed: 19262467
J Neurosci. 2015 Feb 11;35(6):2407-16
pubmed: 25673835
Synapse. 2009 Sep;63(9):782-93
pubmed: 19489048
Science. 2004 Dec 10;306(5703):1940-3
pubmed: 15528409
Nature. 2013 Feb 14;494(7436):238-42
pubmed: 23354054
Neuroimage. 2011 Jan 1;54(1):264-77
pubmed: 20600980
PLoS Comput Biol. 2011 Apr;7(4):e1002028
pubmed: 21556131
Neural Comput. 2017 Dec;29(12):3311-3326
pubmed: 28957023
Proc Natl Acad Sci U S A. 2019 Jan 2;116(1):261-270
pubmed: 30563856
Nat Neurosci. 2019 Dec;22(12):2066-2077
pubmed: 31659343
J Neurosci. 2015 Apr 22;35(16):6298-306
pubmed: 25904783
Neuroimage. 2012 Aug 1;62(1):154-66
pubmed: 22548809
PLoS Biol. 2016 Nov 15;14(11):e1002575
pubmed: 27846219
Nat Hum Behav. 2020 Feb;4(2):201-214
pubmed: 31712764
Nat Neurosci. 2000 Nov;3 Suppl:1218-23
pubmed: 11127841
Neuron. 2014 Dec 17;84(6):1317-28
pubmed: 25482027
Elife. 2017 May 15;6:
pubmed: 28504638
Pharmacol Biochem Behav. 2011 Jan;97(3):551-9
pubmed: 21050870
Neuropsychopharmacology. 2013 Apr;38(5):715-28
pubmed: 23303055
J Neurosci. 2011 May 18;31(20):7291-9
pubmed: 21593313
Neurobiol Aging. 2013 Oct;34(10):2261-70
pubmed: 23623600
J Cereb Blood Flow Metab. 2015 Jul;35(7):1199-205
pubmed: 25853904
Cereb Cortex. 2015 Oct;25(10):3434-45
pubmed: 25056572
Neuroscience. 2014 Dec 12;282:13-22
pubmed: 24463000
Front Neurosci. 2012 Feb 06;6:9
pubmed: 22347155
Front Behav Neurosci. 2010 Nov 04;4:170
pubmed: 21120145
Neuroimage. 2010 Apr 1;50(2):524-531
pubmed: 20034580
Front Hum Neurosci. 2011 May 02;5:39
pubmed: 21629826
Neurobiol Learn Mem. 2018 Sep;153(Pt B):131-136
pubmed: 29269085
Int J Neural Syst. 2006 Apr;16(2):111-24
pubmed: 16688851
Pharmacol Rev. 2011 Mar;63(1):182-217
pubmed: 21303898
Front Behav Neurosci. 2014 Oct 28;8:368
pubmed: 25389395
Psychol Rev. 2007 Jul;114(3):784-805
pubmed: 17638506
Psychopharmacology (Berl). 2008 Jan;196(1):157-65
pubmed: 17912501
J Neurosci. 2015 May 27;35(21):8145-57
pubmed: 26019331
J Cereb Blood Flow Metab. 2012 Jan;32(1):127-36
pubmed: 21878947
Neuron. 2012 Aug 9;75(3):418-24
pubmed: 22884326
Biol Psychiatry. 2008 Nov 1;64(9):739-49
pubmed: 18620336
J Cereb Blood Flow Metab. 2003 Mar;23(3):285-300
pubmed: 12621304
Neuroimage. 2015 Apr 1;109:95-101
pubmed: 25562824
Elife. 2017 Sep 05;6:
pubmed: 28870286
PLoS Comput Biol. 2018 Dec 31;14(12):e1006679
pubmed: 30596638
Neuron. 2017 Oct 11;96(2):267-284
pubmed: 29024654
Trends Cogn Sci. 2012 Oct;16(10):485-8
pubmed: 22940577
Neuron. 2017 Mar 22;93(6):1436-1450.e8
pubmed: 28285820
J Neurosci. 2013 May 8;33(19):8541-8
pubmed: 23658191
J Neurosci. 2010 Oct 20;30(42):14273-83
pubmed: 20962248
Front Hum Neurosci. 2013 Sep 25;7:598
pubmed: 24093015
Neuron. 2006 Sep 7;51(5):541-7
pubmed: 16950153
Psychopharmacology (Berl). 2014 Mar;231(5):955-66
pubmed: 24232442
PLoS Comput Biol. 2014 Jan;10(1):e1003441
pubmed: 24465198
Neuropsychopharmacology. 2014 Sep;39(10):2366-75
pubmed: 24713613
Psychopharmacology (Berl). 2007 Apr;191(3):507-20
pubmed: 17031711
Neuron. 2011 Mar 24;69(6):1204-15
pubmed: 21435563
Neuroimage. 1997 Nov;6(4):279-87
pubmed: 9417971
Nat Neurosci. 2017 Mar 29;20(4):505-512
pubmed: 28352111
Nat Neurosci. 2005 Dec;8(12):1704-11
pubmed: 16286932
PLoS Comput Biol. 2016 Oct 13;12(10):e1005145
pubmed: 27736881
Front Behav Neurosci. 2014 Sep 05;8:304
pubmed: 25249952
J Neurosci. 2013 Feb 27;33(9):3981-8
pubmed: 23447607
Neuroimage. 1996 Dec;4(3 Pt 1):153-8
pubmed: 9345505
Proc Natl Acad Sci U S A. 2018 Oct 23;115(43):E10167-E10176
pubmed: 30297411
Synapse. 2016 Nov;70(11):453-60
pubmed: 27341789
Science. 1997 Mar 14;275(5306):1593-9
pubmed: 9054347
PLoS One. 2018 Jan 5;13(1):e0190429
pubmed: 29304087
Neuropsychologia. 2018 Nov;120:97-104
pubmed: 30347192
Neuroscience. 2014 Dec 12;282:156-75
pubmed: 25062777
Sci Rep. 2016 Aug 19;6:30841
pubmed: 27540831
Psychopharmacology (Berl). 2007 Apr;191(3):599-607
pubmed: 16972103
Front Comput Neurosci. 2015 Nov 04;9:136
pubmed: 26581305