Striatal Dopamine Signals and Reward Learning.
Reward-based learning
dopamine
goal-directed behavior
licking
motor control
neuronal circuits
sensory processing
striatum
synaptic plasticity
whisker sensory perception
Journal
Function (Oxford, England)
ISSN: 2633-8823
Titre abrégé: Function (Oxf)
Pays: England
ID NLM: 101770668
Informations de publication
Date de publication:
2023
2023
Historique:
received:
18
09
2023
revised:
28
09
2023
accepted:
29
09
2023
medline:
23
10
2023
pubmed:
16
10
2023
entrez:
16
10
2023
Statut:
epublish
Résumé
We are constantly bombarded by sensory information and constantly making decisions on how to act. In order to optimally adapt behavior, we must judge which sequences of sensory inputs and actions lead to successful outcomes in specific circumstances. Neuronal circuits of the basal ganglia have been strongly implicated in action selection, as well as the learning and execution of goal-directed behaviors, with accumulating evidence supporting the hypothesis that midbrain dopamine neurons might encode a reward signal useful for learning. Here, we review evidence suggesting that midbrain dopaminergic neurons signal reward prediction error, driving synaptic plasticity in the striatum underlying learning. We focus on phasic increases in action potential firing of midbrain dopamine neurons in response to unexpected rewards. These dopamine neurons prominently innervate the dorsal and ventral striatum. In the striatum, the released dopamine binds to dopamine receptors, where it regulates the plasticity of glutamatergic synapses. The increase of striatal dopamine accompanying an unexpected reward activates dopamine type 1 receptors (D1Rs) initiating a signaling cascade that promotes long-term potentiation of recently active glutamatergic input onto striatonigral neurons. Sensorimotor-evoked glutamatergic input, which is active immediately before reward delivery will thus be strengthened onto neurons in the striatum expressing D1Rs. In turn, these neurons cause disinhibition of brainstem motor centers and disinhibition of the motor thalamus, thus promoting motor output to reinforce rewarded stimulus-action outcomes. Although many details of the hypothesis need further investigation, altogether, it seems likely that dopamine signals in the striatum might underlie important aspects of goal-directed reward-based learning.
Identifiants
pubmed: 37841525
doi: 10.1093/function/zqad056
pii: zqad056
pmc: PMC10572094
doi:
Substances chimiques
Dopamine
VTD58H1Z2X
Types de publication
Journal Article
Review
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
zqad056Informations de copyright
© The Author(s) 2023. Published by Oxford University Press on behalf of American Physiological Society.
Déclaration de conflit d'intérêts
C.C.H.P. holds the position of Editorial Board Member for FUNCTION and is blinded from reviewing or making decisions for the manuscript.
Références
Cell. 2021 May 13;184(10):2733-2749.e16
pubmed: 33861952
Science. 1990 Dec 7;250(4986):1429-32
pubmed: 2147780
Sci Rep. 2022 Feb 4;12(1):1921
pubmed: 35121769
Elife. 2015 Oct 30;4:
pubmed: 26516682
Nature. 2016 Jul 28;535(7613):505-10
pubmed: 27398617
Neuron. 2009 Mar 12;61(5):786-800
pubmed: 19285474
Curr Biol. 2022 Mar 14;32(5):1077-1087.e9
pubmed: 35114098
Neuron. 2021 May 19;109(10):1721-1738.e4
pubmed: 33823137
PLoS One. 2012;7(4):e33612
pubmed: 22506004
Nature. 2015 Apr 16;520(7547):349-52
pubmed: 25624099
Nature. 2010 Jul 29;466(7306):622-6
pubmed: 20613723
Nat Neurosci. 2020 Nov;23(11):1388-1398
pubmed: 32989293
Cell Rep. 2017 Sep 5;20(10):2513-2524
pubmed: 28877482
Nat Neurosci. 2022 Aug;25(8):1082-1092
pubmed: 35798979
Neuron. 2012 Jun 7;74(5):858-73
pubmed: 22681690
Nature. 2012 Jan 18;482(7383):85-8
pubmed: 22258508
Nature. 1995 Oct 26;377(6551):725-8
pubmed: 7477260
Science. 2009 May 22;324(5930):1080-4
pubmed: 19389999
Nature. 2015 Sep 10;525(7568):243-6
pubmed: 26322583
J Neurosci Res. 2010 Apr;88(5):981-91
pubmed: 19885830
Nature. 1997 Feb 6;385(6616):533-6
pubmed: 9020359
Science. 2006 Mar 17;311(5767):1606-9
pubmed: 16543459
Neuron. 2014 Sep 3;83(5):1200-12
pubmed: 25155959
J Neurosci. 2000 May 15;20(10):3864-73
pubmed: 10804226
Nat Neurosci. 2016 Jun;19(6):845-54
pubmed: 27110917
Neuron. 2017 Dec 20;96(6):1272-1281.e4
pubmed: 29268095
J Comp Neurol. 1996 Jan 08;364(2):254-66
pubmed: 8788248
Nat Neurosci. 2012 Jun;15(6):816-8
pubmed: 22544310
J Neurosci. 1996 Mar 1;16(5):1936-47
pubmed: 8774460
Neuron. 2014 Feb 19;81(4):901-12
pubmed: 24559678
Psychol Rev. 1951 Sep;58(5):313-23
pubmed: 14883244
Nat Neurosci. 2013 Nov;16(11):1671-7
pubmed: 24097038
Neural Comput. 2014 Mar;26(3):467-71
pubmed: 24320851
Nature. 2023 Mar;615(7954):884-891
pubmed: 36922596
Nature. 2007 Jun 28;447(7148):1111-5
pubmed: 17522629
Nature. 2015 May 21;521(7552):348-51
pubmed: 25731173
Science. 2005 Mar 11;307(5715):1642-5
pubmed: 15761155
Cell. 2018 Jul 12;174(2):481-496.e19
pubmed: 30007419
J Neurosci. 2013 Nov 20;33(47):18531-9
pubmed: 24259575
J Neurosci. 2008 Mar 5;28(10):2435-46
pubmed: 18322089
Nature. 2013 Jul 18;499(7458):295-300
pubmed: 23868258
Neuron. 2013 Feb 20;77(4):723-35
pubmed: 23439124
J Neurosci. 2020 Sep 23;40(39):7489-7509
pubmed: 32859713
Science. 2014 Sep 26;345(6204):1616-20
pubmed: 25258080
Nature. 2016 May 02;533(7603):402-6
pubmed: 27135927
Neuron. 1995 Feb;14(2):385-97
pubmed: 7531987
Neuron. 2022 Dec 21;110(24):4176-4193.e10
pubmed: 36240769
Neuron. 2012 Mar 22;73(6):1173-83
pubmed: 22445344
Brain Res. 1986 Jun 11;375(2):368-72
pubmed: 2942222
Science. 2017 Sep 15;357(6356):1149-1155
pubmed: 28912243
Neuron. 2015 Oct 21;88(2):298-305
pubmed: 26439527
Nature. 2018 Feb 8;554(7691):244-248
pubmed: 29420469
J Neurosci. 2013 Apr 10;33(15):6454-9
pubmed: 23575843
Psychol Rev. 1951 Nov;58(6):413-23
pubmed: 14900302
Neuron. 2015 Nov 4;88(3):528-38
pubmed: 26593091
Cell. 2018 Jun 28;174(1):44-58.e17
pubmed: 29779950
J Neurosci. 1993 Mar;13(3):900-13
pubmed: 8441015
J Neurosci. 2010 Jan 6;30(1):218-29
pubmed: 20053904
J Neurosci. 2001 Aug 15;21(16):RC160
pubmed: 11473131
Nature. 2022 Aug;608(7922):374-380
pubmed: 35831501
Nature. 2021 Feb;590(7846):451-456
pubmed: 33361810
Neuron. 2020 Feb 19;105(4):700-711.e6
pubmed: 31859030
Nature. 2020 Mar;579(7800):555-560
pubmed: 32214250
Science. 2003 Mar 21;299(5614):1898-902
pubmed: 12649484
Nature. 2013 Aug 29;500(7464):575-9
pubmed: 23913271
Function (Oxf). 2021 Sep 21;2(6):zqab049
pubmed: 35330797
Nat Neurosci. 1998 Aug;1(4):304-9
pubmed: 10195164
Neuron. 2015 Sep 23;87(6):1304-1316
pubmed: 26365765
Curr Biol. 2023 Aug 21;33(16):3436-3451.e7
pubmed: 37536343
Nature. 2023 Feb;614(7946):108-117
pubmed: 36653449
Nature. 2010 Jul 22;466(7305):457-62
pubmed: 20651684
Science. 2008 Aug 8;321(5890):848-51
pubmed: 18687967
Elife. 2020 Dec 21;9:
pubmed: 33345774
J Neurophysiol. 1992 Jan;67(1):145-63
pubmed: 1552316
Cell. 2020 Dec 10;183(6):1600-1616.e25
pubmed: 33248024
Cell Rep. 2014 Aug 21;8(4):1105-18
pubmed: 25108805
Neuron. 2020 Apr 22;106(2):277-290.e6
pubmed: 32075716
Science. 2018 Jun 29;360(6396):
pubmed: 29853555
Neuron. 2022 Nov 16;110(22):3789-3804.e9
pubmed: 36130595
Neuron. 2015 Dec 2;88(5):1054-1066
pubmed: 26586182
Cell. 2015 Jan 29;160(3):528-41
pubmed: 25635460
Science. 1997 Mar 14;275(5306):1593-9
pubmed: 9054347
Science. 2019 Apr 19;364(6437):253
pubmed: 30948440
Neuron. 2007 Mar 1;53(5):639-47
pubmed: 17329205
Nature. 2012 Nov 8;491(7423):212-7
pubmed: 23064228
J Neurophysiol. 1990 Mar;63(3):592-606
pubmed: 2329363
Nat Neurosci. 2018 Oct;21(10):1421-1430
pubmed: 30177795
Science. 2022 Dec 23;378(6626):eabq6740
pubmed: 36480599
Proc Natl Acad Sci U S A. 2014 Apr 29;111(17):6455-60
pubmed: 24737889
Elife. 2017 May 31;6:
pubmed: 28561735
Cell. 2015 Jul 30;162(3):622-34
pubmed: 26232228
Curr Biol. 2022 Apr 25;32(8):1829-1836.e4
pubmed: 35259343
Neuron. 2020 Mar 18;105(6):1036-1047.e5
pubmed: 31954621
Cereb Cortex. 2016 Dec;26(12):4405-4415
pubmed: 27664965
Neuron. 2020 Apr 8;106(1):142-153.e7
pubmed: 32027824
Nature. 2013 Feb 14;494(7436):238-42
pubmed: 23354054
Nat Neurosci. 2008 Aug;11(8):966-73
pubmed: 18660807