Variability in Action Selection Relates to Striatal Dopamine 2/3 Receptor Availability in Humans: A PET Neuroimaging Study Using Reinforcement Learning and Active Inference Models.


Journal

Cerebral cortex (New York, N.Y. : 1991)
ISSN: 1460-2199
Titre abrégé: Cereb Cortex
Pays: United States
ID NLM: 9110718

Informations de publication

Date de publication:
18 05 2020
Historique:
received: 12 09 2019
revised: 18 11 2019
accepted: 05 12 2019
pubmed: 23 2 2020
medline: 21 12 2021
entrez: 22 2 2020
Statut: ppublish

Résumé

Choosing actions that result in advantageous outcomes is a fundamental function of nervous systems. All computational decision-making models contain a mechanism that controls the variability of (or confidence in) action selection, but its neural implementation is unclear-especially in humans. We investigated this mechanism using two influential decision-making frameworks: active inference (AI) and reinforcement learning (RL). In AI, the precision (inverse variance) of beliefs about policies controls action selection variability-similar to decision 'noise' parameters in RL-and is thought to be encoded by striatal dopamine signaling. We tested this hypothesis by administering a 'go/no-go' task to 75 healthy participants, and measuring striatal dopamine 2/3 receptor (D2/3R) availability in a subset (n = 25) using [11C]-(+)-PHNO positron emission tomography. In behavioral model comparison, RL performed best across the whole group but AI performed best in participants performing above chance levels. Limbic striatal D2/3R availability had linear relationships with AI policy precision (P = 0.029) as well as with RL irreducible decision 'noise' (P = 0.020), and this relationship with D2/3R availability was confirmed with a 'decision stochasticity' factor that aggregated across both models (P = 0.0006). These findings are consistent with occupancy of inhibitory striatal D2/3Rs decreasing the variability of action selection in humans.

Identifiants

pubmed: 32083297
pii: 5741370
doi: 10.1093/cercor/bhz327
pmc: PMC7233027
doi:

Substances chimiques

DRD2 protein, human 0
DRD3 protein, human 0
Dopamine Agonists 0
Oxazines 0
Receptors, Dopamine D2 0
Receptors, Dopamine D3 0
naxagolide 22Z7E0X6OF

Types de publication

Journal Article Research Support, Non-U.S. Gov't

Langues

eng

Sous-ensembles de citation

IM

Pagination

3573-3589

Subventions

Organisme : Medical Research Council
ID : MR/N027078/1
Pays : United Kingdom
Organisme : Medical Research Council
ID : MR/L022176/1
Pays : United Kingdom
Organisme : Medical Research Council
ID : MC_U120097115
Pays : United Kingdom
Organisme : Medical Research Council
ID : G0700995
Pays : United Kingdom
Organisme : Medical Research Council
ID : MR/S007806/1
Pays : United Kingdom
Organisme : Medical Research Council
ID : MR/N026063/1
Pays : United Kingdom
Organisme : Wellcome Trust
ID : 095844/7/11/Z
Pays : United Kingdom
Organisme : Wellcome Trust
ID : 088130/Z/09/Z
Pays : United Kingdom
Organisme : Wellcome Trust
ID : 094849/Z/10/Z
Pays : United Kingdom

Informations de copyright

© The Author(s) 2020. Published by Oxford University Press.

Références

Psychol Rev. 1980 Nov;87(6):532-52
pubmed: 7443916
eNeuro. 2018 Oct 5;5(4):
pubmed: 30302389
Nature. 2006 Jun 15;441(7095):876-9
pubmed: 16778890
Neuroscientist. 2009 Dec;15(6):635-50
pubmed: 19793723
Biol Psychiatry. 2011 Jun 15;69(12):e113-25
pubmed: 21531388
Neuropsychopharmacology. 2009 Jul;34(8):2041-52
pubmed: 19262467
J Neurosci. 2015 Feb 11;35(6):2407-16
pubmed: 25673835
Synapse. 2009 Sep;63(9):782-93
pubmed: 19489048
Science. 2004 Dec 10;306(5703):1940-3
pubmed: 15528409
Nature. 2013 Feb 14;494(7436):238-42
pubmed: 23354054
Neuroimage. 2011 Jan 1;54(1):264-77
pubmed: 20600980
PLoS Comput Biol. 2011 Apr;7(4):e1002028
pubmed: 21556131
Neural Comput. 2017 Dec;29(12):3311-3326
pubmed: 28957023
Proc Natl Acad Sci U S A. 2019 Jan 2;116(1):261-270
pubmed: 30563856
Nat Neurosci. 2019 Dec;22(12):2066-2077
pubmed: 31659343
J Neurosci. 2015 Apr 22;35(16):6298-306
pubmed: 25904783
Neuroimage. 2012 Aug 1;62(1):154-66
pubmed: 22548809
PLoS Biol. 2016 Nov 15;14(11):e1002575
pubmed: 27846219
Nat Hum Behav. 2020 Feb;4(2):201-214
pubmed: 31712764
Nat Neurosci. 2000 Nov;3 Suppl:1218-23
pubmed: 11127841
Neuron. 2014 Dec 17;84(6):1317-28
pubmed: 25482027
Elife. 2017 May 15;6:
pubmed: 28504638
Pharmacol Biochem Behav. 2011 Jan;97(3):551-9
pubmed: 21050870
Neuropsychopharmacology. 2013 Apr;38(5):715-28
pubmed: 23303055
J Neurosci. 2011 May 18;31(20):7291-9
pubmed: 21593313
Neurobiol Aging. 2013 Oct;34(10):2261-70
pubmed: 23623600
J Cereb Blood Flow Metab. 2015 Jul;35(7):1199-205
pubmed: 25853904
Cereb Cortex. 2015 Oct;25(10):3434-45
pubmed: 25056572
Neuroscience. 2014 Dec 12;282:13-22
pubmed: 24463000
Front Neurosci. 2012 Feb 06;6:9
pubmed: 22347155
Front Behav Neurosci. 2010 Nov 04;4:170
pubmed: 21120145
Neuroimage. 2010 Apr 1;50(2):524-531
pubmed: 20034580
Front Hum Neurosci. 2011 May 02;5:39
pubmed: 21629826
Neurobiol Learn Mem. 2018 Sep;153(Pt B):131-136
pubmed: 29269085
Int J Neural Syst. 2006 Apr;16(2):111-24
pubmed: 16688851
Pharmacol Rev. 2011 Mar;63(1):182-217
pubmed: 21303898
Front Behav Neurosci. 2014 Oct 28;8:368
pubmed: 25389395
Psychol Rev. 2007 Jul;114(3):784-805
pubmed: 17638506
Psychopharmacology (Berl). 2008 Jan;196(1):157-65
pubmed: 17912501
J Neurosci. 2015 May 27;35(21):8145-57
pubmed: 26019331
J Cereb Blood Flow Metab. 2012 Jan;32(1):127-36
pubmed: 21878947
Neuron. 2012 Aug 9;75(3):418-24
pubmed: 22884326
Biol Psychiatry. 2008 Nov 1;64(9):739-49
pubmed: 18620336
J Cereb Blood Flow Metab. 2003 Mar;23(3):285-300
pubmed: 12621304
Neuroimage. 2015 Apr 1;109:95-101
pubmed: 25562824
Elife. 2017 Sep 05;6:
pubmed: 28870286
PLoS Comput Biol. 2018 Dec 31;14(12):e1006679
pubmed: 30596638
Neuron. 2017 Oct 11;96(2):267-284
pubmed: 29024654
Trends Cogn Sci. 2012 Oct;16(10):485-8
pubmed: 22940577
Neuron. 2017 Mar 22;93(6):1436-1450.e8
pubmed: 28285820
J Neurosci. 2013 May 8;33(19):8541-8
pubmed: 23658191
J Neurosci. 2010 Oct 20;30(42):14273-83
pubmed: 20962248
Front Hum Neurosci. 2013 Sep 25;7:598
pubmed: 24093015
Neuron. 2006 Sep 7;51(5):541-7
pubmed: 16950153
Psychopharmacology (Berl). 2014 Mar;231(5):955-66
pubmed: 24232442
PLoS Comput Biol. 2014 Jan;10(1):e1003441
pubmed: 24465198
Neuropsychopharmacology. 2014 Sep;39(10):2366-75
pubmed: 24713613
Psychopharmacology (Berl). 2007 Apr;191(3):507-20
pubmed: 17031711
Neuron. 2011 Mar 24;69(6):1204-15
pubmed: 21435563
Neuroimage. 1997 Nov;6(4):279-87
pubmed: 9417971
Nat Neurosci. 2017 Mar 29;20(4):505-512
pubmed: 28352111
Nat Neurosci. 2005 Dec;8(12):1704-11
pubmed: 16286932
PLoS Comput Biol. 2016 Oct 13;12(10):e1005145
pubmed: 27736881
Front Behav Neurosci. 2014 Sep 05;8:304
pubmed: 25249952
J Neurosci. 2013 Feb 27;33(9):3981-8
pubmed: 23447607
Neuroimage. 1996 Dec;4(3 Pt 1):153-8
pubmed: 9345505
Proc Natl Acad Sci U S A. 2018 Oct 23;115(43):E10167-E10176
pubmed: 30297411
Synapse. 2016 Nov;70(11):453-60
pubmed: 27341789
Science. 1997 Mar 14;275(5306):1593-9
pubmed: 9054347
PLoS One. 2018 Jan 5;13(1):e0190429
pubmed: 29304087
Neuropsychologia. 2018 Nov;120:97-104
pubmed: 30347192
Neuroscience. 2014 Dec 12;282:156-75
pubmed: 25062777
Sci Rep. 2016 Aug 19;6:30841
pubmed: 27540831
Psychopharmacology (Berl). 2007 Apr;191(3):599-607
pubmed: 16972103
Front Comput Neurosci. 2015 Nov 04;9:136
pubmed: 26581305

Auteurs

Rick A Adams (RA)

Institute of Cognitive Neuroscience, University College London, London WC1N 3AZ, UK.
Division of Psychiatry, University College London, London W1T 7NF, UK.
Psychiatric Imaging Group, Robert Steiner MRI Unit, MRC London Institute of Medical Sciences, Hammersmith Hospital, London W12 0NN, UK.
Institute of Clinical Sciences, Faculty of Medicine, Imperial College London, Hammersmith Hospital, London W12 0NN, UK.

Michael Moutoussis (M)

Wellcome Centre for Human Neuroimaging, University College London, London WC1N 3BG, UK.
Max Planck-UCL Centre for Computational Psychiatry and Ageing Research, London WC1B 5EH, UK.

Matthew M Nour (MM)

Psychiatric Imaging Group, Robert Steiner MRI Unit, MRC London Institute of Medical Sciences, Hammersmith Hospital, London W12 0NN, UK.
Institute of Clinical Sciences, Faculty of Medicine, Imperial College London, Hammersmith Hospital, London W12 0NN, UK.
Department of Psychosis Studies, Institute of Psychiatry, Psychology & Neuroscience (IoPPN), King's College London, London SE5 8AF, UK.

Tarik Dahoun (T)

Psychiatric Imaging Group, Robert Steiner MRI Unit, MRC London Institute of Medical Sciences, Hammersmith Hospital, London W12 0NN, UK.
Institute of Clinical Sciences, Faculty of Medicine, Imperial College London, Hammersmith Hospital, London W12 0NN, UK.
Department of Psychiatry, University of Oxford, Warneford Hospital, Oxford OX3 7JX, UK.

Declan Lewis (D)

Institute of Cognitive Neuroscience, University College London, London WC1N 3AZ, UK.

Benjamin Illingworth (B)

Institute of Cognitive Neuroscience, University College London, London WC1N 3AZ, UK.

Mattia Veronese (M)

Centre for Neuroimaging Sciences, Institute of Psychiatry, Psychology & Neuroscience (IoPPN), King's College London, London SE5 8AF, UK.

Christoph Mathys (C)

Max Planck-UCL Centre for Computational Psychiatry and Ageing Research, London WC1B 5EH, UK.
Scuola Internazionale Superiore di Studi Avanzati (SISSA), 34136 Trieste, Italy.
Translational Neuromodeling Unit (TNU), Institute for Biomedical Engineering, University of Zurich and ETH Zurich, 8032 Zurich, Switzerland.

Lieke de Boer (L)

Aging Research Center, Karolinska Institute, 171 65 Stockholm, Sweden.

Marc Guitart-Masip (M)

Max Planck-UCL Centre for Computational Psychiatry and Ageing Research, London WC1B 5EH, UK.
Aging Research Center, Karolinska Institute, 171 65 Stockholm, Sweden.

Karl J Friston (KJ)

Wellcome Centre for Human Neuroimaging, University College London, London WC1N 3BG, UK.

Oliver D Howes (OD)

Psychiatric Imaging Group, Robert Steiner MRI Unit, MRC London Institute of Medical Sciences, Hammersmith Hospital, London W12 0NN, UK.
Institute of Clinical Sciences, Faculty of Medicine, Imperial College London, Hammersmith Hospital, London W12 0NN, UK.
Department of Psychosis Studies, Institute of Psychiatry, Psychology & Neuroscience (IoPPN), King's College London, London SE5 8AF, UK.

Jonathan P Roiser (JP)

Institute of Cognitive Neuroscience, University College London, London WC1N 3AZ, UK.

Articles similaires

[Redispensing of expensive oral anticancer medicines: a practical application].

Lisanne N van Merendonk, Kübra Akgöl, Bastiaan Nuijen
1.00
Humans Antineoplastic Agents Administration, Oral Drug Costs Counterfeit Drugs

Smoking Cessation and Incident Cardiovascular Disease.

Jun Hwan Cho, Seung Yong Shin, Hoseob Kim et al.
1.00
Humans Male Smoking Cessation Cardiovascular Diseases Female
Humans United States Aged Cross-Sectional Studies Medicare Part C
1.00
Humans Yoga Low Back Pain Female Male

Classifications MeSH