A Unified Framework for Dopamine Signals across Timescales.
Action Potentials
/ physiology
Animals
Axons
/ metabolism
Calcium
/ metabolism
Calcium Signaling
Cell Body
/ metabolism
Cues
Dopamine
/ metabolism
Dopaminergic Neurons
/ physiology
Fluorometry
Male
Mice, Inbred C57BL
Models, Neurological
Photic Stimulation
Reward
Sensation
Signal Transduction
Time Factors
Ventral Tegmental Area
/ metabolism
Virtual Reality
Journal
Cell
ISSN: 1097-4172
Titre abrégé: Cell
Pays: United States
ID NLM: 0413066
Informations de publication
Date de publication:
10 12 2020
10 12 2020
Historique:
received:
15
10
2019
revised:
20
08
2020
accepted:
09
11
2020
pubmed:
29
11
2020
medline:
19
5
2021
entrez:
28
11
2020
Statut:
ppublish
Résumé
Rapid phasic activity of midbrain dopamine neurons is thought to signal reward prediction errors (RPEs), resembling temporal difference errors used in machine learning. However, recent studies describing slowly increasing dopamine signals have instead proposed that they represent state values and arise independent from somatic spiking activity. Here we developed experimental paradigms using virtual reality that disambiguate RPEs from values. We examined dopamine circuit activity at various stages, including somatic spiking, calcium signals at somata and axons, and striatal dopamine concentrations. Our results demonstrate that ramping dopamine signals are consistent with RPEs rather than value, and this ramping is observed at all stages examined. Ramping dopamine signals can be driven by a dynamic stimulus that indicates a gradual approach to a reward. We provide a unified computational understanding of rapid phasic and slowly ramping dopamine signals: dopamine neurons perform a derivative-like computation over values on a moment-by-moment basis.
Identifiants
pubmed: 33248024
pii: S0092-8674(20)31530-0
doi: 10.1016/j.cell.2020.11.013
pmc: PMC7736562
mid: NIHMS1646306
pii:
doi:
Substances chimiques
Calcium
SY7Q814VUP
Dopamine
VTD58H1Z2X
Types de publication
Journal Article
Research Support, N.I.H., Extramural
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
1600-1616.e25Subventions
Organisme : NINDS NIH HHS
ID : U01 NS103558
Pays : United States
Organisme : NIGMS NIH HHS
ID : T32 GM007753
Pays : United States
Organisme : NINDS NIH HHS
ID : U19 NS113201
Pays : United States
Organisme : NINDS NIH HHS
ID : R01 NS108740
Pays : United States
Organisme : NIMH NIH HHS
ID : T32 MH020017
Pays : United States
Organisme : NIMH NIH HHS
ID : R01 MH101207
Pays : United States
Organisme : NIMH NIH HHS
ID : R01 MH095953
Pays : United States
Informations de copyright
Copyright © 2020 Elsevier Inc. All rights reserved.
Déclaration de conflit d'intérêts
Declaration of Interests The authors declare no competing interests.
Références
Proc Natl Acad Sci U S A. 2016 Apr 12;113(15):3932-7
pubmed: 27035946
J Neurosci. 2004 Feb 11;24(6):1265-71
pubmed: 14960596
Brain Res Rev. 2007 Nov;56(1):27-78
pubmed: 17574681
Front Neural Circuits. 2014 Apr 09;8:36
pubmed: 24782717
Curr Opin Neurobiol. 1997 Apr;7(2):170-84
pubmed: 9142762
Elife. 2019 Nov 01;8:
pubmed: 31674910
Annu Rev Neurosci. 2017 Jul 25;40:373-394
pubmed: 28441114
Neuron. 2007 Oct 4;56(1):43-57
pubmed: 17920014
Nature. 2016 Jul 28;535(7613):505-10
pubmed: 27398617
Nature. 2009 Oct 15;461(7266):941-6
pubmed: 19829374
Nat Neurosci. 2010 Jan;13(1):133-40
pubmed: 20023653
Nature. 2012 Jan 18;482(7383):85-8
pubmed: 22258508
Science. 2009 May 22;324(5930):1080-4
pubmed: 19389999
Cell Rep. 2012 Jul 26;2(1):33-41
pubmed: 22840394
Nature. 2015 Sep 10;525(7568):243-6
pubmed: 26322583
Nat Neurosci. 2001 Dec;4(12):1224-9
pubmed: 11713470
J Neurophysiol. 2004 May;91(5):2259-72
pubmed: 14736863
Neuron. 2012 Jul 12;75(1):58-64
pubmed: 22794260
PLoS Comput Biol. 2015 Dec 23;11(12):e1004622
pubmed: 26699940
Nature. 2019 Jun;570(7762):509-513
pubmed: 31142844
Nature. 2013 Jun 20;498(7454):363-6
pubmed: 23708967
J Neurosci. 2008 Jul 30;28(31):7837-46
pubmed: 18667616
Nature. 2003 Apr 10;422(6932):614-8
pubmed: 12687000
Curr Opin Neurobiol. 2012 Dec;22(6):1054-61
pubmed: 22749132
Nat Neurosci. 2016 Jun;19(6):845-54
pubmed: 27110917
J Neurosci. 2015 Feb 11;35(6):2766-77
pubmed: 25673864
F1000Res. 2019 Sep 24;8:
pubmed: 31588354
Neuron. 2017 Sep 13;95(6):1395-1405.e3
pubmed: 28910622
Neural Comput. 2014 Mar;26(3):467-71
pubmed: 24320851
Nat Rev Neurosci. 2019 Aug;20(8):482-494
pubmed: 31171839
Nature. 2013 Jul 18;499(7458):295-300
pubmed: 23868258
J Neurosci. 2020 Sep 23;40(39):7489-7509
pubmed: 32859713
Cold Spring Harb Symp Quant Biol. 2018;83:83-95
pubmed: 30787046
Genesis. 2006 Aug;44(8):383-90
pubmed: 16865686
Nature. 2020 Jan;577(7792):671-675
pubmed: 31942076
Psychol Rev. 1988 Apr;95(2):274-95
pubmed: 3375401
Neuron. 2010 Jul 15;67(1):144-55
pubmed: 20624598
Science. 2009 Apr 3;324(5923):81-5
pubmed: 19342586
Nature. 2013 Aug 29;500(7464):575-9
pubmed: 23913271
Nature. 2019 Jun;570(7759):65-70
pubmed: 31118513
PLoS One. 2009 Jul 07;4(7):e6099
pubmed: 19584920
Nat Rev Neurosci. 2019 Nov;20(11):703-714
pubmed: 31570826
Nat Neurosci. 2018 Jun;21(6):787-793
pubmed: 29760524
Nat Neurosci. 2016 Jan;19(1):117-26
pubmed: 26595651
Nat Commun. 2018 May 14;9(1):1891
pubmed: 29760401
Nat Neurosci. 2003 Nov;6(11):1224-9
pubmed: 14566341
Neuron. 2014 Oct 22;84(2):442-56
pubmed: 25374363
Science. 1997 Mar 14;275(5306):1593-9
pubmed: 9054347
Proc Natl Acad Sci U S A. 2013 Jan 2;110(1):378-83
pubmed: 23256159
Nat Neurosci. 2018 Oct;21(10):1421-1430
pubmed: 30177795
Neuron. 2005 Jul 7;47(1):129-41
pubmed: 15996553
Neural Comput. 2008 Dec;20(12):3034-54
pubmed: 18624657
Elife. 2017 Jan 05;6:
pubmed: 28054919
Neuron. 2008 Mar 13;57(5):760-73
pubmed: 18341995
Nat Neurosci. 2017 Apr;20(4):581-589
pubmed: 28263301
Nat Neurosci. 2008 Aug;11(8):966-73
pubmed: 18660807
Elife. 2019 Oct 03;8:
pubmed: 31580257