Predictive and reactive reward signals conveyed by climbing fiber inputs to cerebellar Purkinje cells.
Journal
Nature neuroscience
ISSN: 1546-1726
Titre abrégé: Nat Neurosci
Pays: United States
ID NLM: 9809671
Informations de publication
Date de publication:
06 2019
06 2019
Historique:
received:
30
07
2018
accepted:
11
03
2019
pubmed:
1
5
2019
medline:
6
7
2019
entrez:
1
5
2019
Statut:
ppublish
Résumé
There is increasing evidence for a cerebellar contribution to cognitive processing, but the specific input pathways conveying this information remain unclear. We probed the role of climbing fiber inputs to Purkinje cells in generating and evaluating predictions about associations between motor actions, sensory stimuli and reward. We trained mice to perform a visuomotor integration task to receive a reward and interleaved cued and random rewards between task trials. Using two-photon calcium imaging and Neuropixels probe recordings of Purkinje cell activity, we show that climbing fibers signal reward expectation, delivery and omission. These signals map onto cerebellar microzones, with reward delivery activating some microzones and suppressing others, and with reward omission activating both reward-activated and reward-suppressed microzones. Moreover, responses to predictable rewards are progressively suppressed during learning. Our findings elucidate a specific input pathway for cerebellar contributions to reward signaling and provide a mechanistic link between cerebellar activity and the creation and evaluation of predictions.
Identifiants
pubmed: 31036947
doi: 10.1038/s41593-019-0381-8
pii: 10.1038/s41593-019-0381-8
pmc: PMC7612392
mid: EMS142171
doi:
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
950-962Subventions
Organisme : Wellcome Trust
Pays : United Kingdom
Organisme : Wellcome Trust
ID : 201225
Pays : United Kingdom
Organisme : Wellcome Trust
ID : 201225/Z/16/Z
Pays : United Kingdom
Organisme : European Research Council
ID : 250345
Pays : International
Commentaires et corrections
Type : CommentIn
Type : ErratumIn
Références
Wolpert, D. M., Miall, R. C. & Kawato, M. Internal models in the cerebellum. Trends Cogn. Sci. 2, 338–347 (1998).
doi: 10.1016/S1364-6613(98)01221-2
pubmed: 21227230
Kawato, M., Furukawa, K. & Suzuki, R. A hierarchical neural-network model for control and learning of voluntary movement. Biol. Cybern. 57, 169–185 (1987).
doi: 10.1007/BF00364149
pubmed: 3676355
Medina, J. F. The multiple roles of Purkinje cells in sensori-motor calibration: to predict, teach and command. Curr. Opin. Neurobiol. 21, 616–622 (2011).
doi: 10.1016/j.conb.2011.05.025
pubmed: 21684147
pmcid: 3957422
Marr, D. A theory of cerebellar cortex. J. Physiol. 202, 437–470 (1969).
doi: 10.1113/jphysiol.1969.sp008820
pubmed: 5784296
pmcid: 1351491
Albus, J. A. A theory of cerebellar function. Math. Biosci. 10, 25–61 (1971).
doi: 10.1016/0025-5564(71)90051-4
Ito, M. Cerebellar long-term depression: characterization, signal transduction, and functional roles. Physiol. Rev. 81, 1143–1195 (2001).
doi: 10.1152/physrev.2001.81.3.1143
pubmed: 11427694
Apps, R. & Garwicz, M. Anatomical and physiological foundations of cerebellar information processing. Nat. Rev. Neurosci. 6, 297–311 (2005).
doi: 10.1038/nrn1646
pubmed: 15803161
Sugihara, I. & Shinoda, Y. Molecular, topographic, and functional organization of the cerebellar cortex: a study with combined aldolase C and olivocerebellar labeling. J. Neurosci. 24, 8771–8785 (2004).
doi: 10.1523/JNEUROSCI.1961-04.2004
pubmed: 15470143
pmcid: 6729951
Mathy, A. et al. Encoding of oscillations by axonal bursts in inferior olive neurons. Neuron 62, 388–399 (2009).
doi: 10.1016/j.neuron.2009.03.023
pubmed: 19447094
pmcid: 2777250
Llinas, R., Baker, R. & Sotelo, C. Electrotonic coupling between neurons in cat inferior olive. J. Neurophysiol. 37, 560–571 (1974).
doi: 10.1152/jn.1974.37.3.560
pubmed: 4827022
Tang, T., Blenkinsop, T. A. & Lang, E. J. Complex spike synchrony dependent modulation of rat deep cerebellar nuclear activity. eLife 8, e40101 (2019).
doi: 10.7554/eLife.40101
pubmed: 30624204
pmcid: 6326725
Welsh, J. P., Lang, E. J., Suglhara, I. & Llinás, R. Dynamic organization of motor control within the olivocerebellar system. Nature 374, 453–457 (1995).
doi: 10.1038/374453a0
pubmed: 7700354
Ozden, I., Dombeck, D. A., Hoogland, T. M., Tank, D. W. & Wang, S. S. Widespread state-dependent shifts in cerebellar activity in locomoting mice. PLoS One 7, e42650 (2012).
doi: 10.1371/journal.pone.0042650
pubmed: 22880068
pmcid: 3411825
Ghosh, K. K. et al. Miniaturized integration of a fluorescence microscope. Nat. Methods 8, 871–878 (2011).
doi: 10.1038/nmeth.1694
pubmed: 21909102
pmcid: 3810311
Heffley, W. et al. Coordinated cerebellar climbing fiber activity signals learned sensorimotor predictions. Nat. Neurosci. 21, 1431–1441 (2018).
doi: 10.1038/s41593-018-0228-8
pubmed: 30224805
pmcid: 6362851
De Gruijl, J. R., Hoogland, T. M. & De Zeeuw, C. I. Behavioral correlates of complex spike synchrony in cerebellar microzones. J. Neurosci. 34, 8937–8947 (2014).
doi: 10.1523/JNEUROSCI.5064-13.2014
pubmed: 24990915
pmcid: 6608251
Hoogland, T. M., De Gruijl, J. R., Witter, L., Canto, C. B. & De Zeeuw, C. I. Role of synchronous activation of cerebellar purkinje cell ensembles in multi-joint movement control. Curr. Biol. 25, 1157–1165 (2015).
doi: 10.1016/j.cub.2015.03.009
pubmed: 25843032
pmcid: 4425462
Najafi, F., Giovannucci, A., Wang, S. S. & Medina, J. F. Coding of stimulus strength via analog calcium signals in Purkinje cell dendrites of awake mice. eLife 3, e03663 (2014).
doi: 10.7554/eLife.03663
pubmed: 25205669
pmcid: 4158287
Mukamel, E. A., Nimmerjahn, A. & Schnitzer, M. J. Automated analysis of cellular signals from large-scale calcium imaging data. Neuron 63, 747–760 (2009).
doi: 10.1016/j.neuron.2009.08.009
pubmed: 19778505
pmcid: 3282191
Deverett, B., Koay, S. A., Oostland, M. & Wang, S. S. Cerebellar involvement in an evidence-accumulation decision-making task. eLife 7, e36781 (2018).
doi: 10.7554/eLife.36781
pubmed: 30102151
pmcid: 6105309
Medina, J. F. & Lisberger, S. G. Links from complex spikes to local plasticity and motor learning in the cerebellum of awake-behaving monkeys. Nat. Neurosci. 11, 1185–1192 (2008).
doi: 10.1038/nn.2197
pubmed: 18806784
pmcid: 2577564
Yang, Y. & Lisberger, S. G. Purkinje-cell plasticity and cerebellar motor learning are graded by complex-spike duration. Nature 510, 529–532 (2014).
doi: 10.1038/nature13282
pubmed: 24814344
pmcid: 4132823
Strick, P. L., Dum, R. P. & Fiez, J. A. Cerebellum and nonmotor function. Annu. Rev. Neurosci. 32, 413–434 (2009).
doi: 10.1146/annurev.neuro.31.060407.125606
pubmed: 19555291
Rochefort, C. et al. Cerebellum shapes hippocampal spatial code. Science 334, 385–389 (2011).
doi: 10.1126/science.1207403
pubmed: 22021859
Stoodley, C. J. & Schmahmann, J. D. Functional topography in the human cerebellum: a meta-analysis of neuroimaging studies. Neuroimage 44, 489–501 (2009).
doi: 10.1016/j.neuroimage.2008.08.039
pubmed: 18835452
Wagner, M. J., Kim, T. H., Savall, J., Schnitzer, M. J. & Luo, L. Cerebellar granule cells encode the expectation of reward. Nature 544, 96–100 (2017).
doi: 10.1038/nature21726
pubmed: 28321129
pmcid: 5532014
Lee, K. H. et al. Circuit mechanisms underlying motor memory formation in the cerebellum. Neuron 86, 529–540 (2015).
doi: 10.1016/j.neuron.2015.03.010
pubmed: 25843404
pmcid: 4417109
Ozden, I., Sullivan, M. R., Lee, H. M. & Wang, S. S. Reliable coding emerges from coactivation of climbing fibers in microbands of cerebellar Purkinje neurons. J. Neurosci. 29, 10463–10473 (2009).
doi: 10.1523/JNEUROSCI.0967-09.2009
pubmed: 19710300
pmcid: 2783593
Kitamura, K. & Häusser, M. Dendritic calcium signaling triggered by spontaneous and sensory-evoked climbing fiber input to cerebellar Purkinje cells in vivo. J. Neurosci. 31, 10847–10858 (2011).
doi: 10.1523/JNEUROSCI.2525-10.2011
pubmed: 21795537
pmcid: 3758548
Schultz, S. R., Kitamura, K., Post-Uiterweer, A., Krupic, J. & Häusser, M. Spatial pattern coding of sensory information by climbing fiber-evoked calcium signals in networks of neighboring cerebellar Purkinje cells. J. Neurosci. 29, 8005–8015 (2009).
doi: 10.1523/JNEUROSCI.4919-08.2009
pubmed: 19553440
pmcid: 6666035
Gaffield, M. A., Bonnan, A. & Christie, J. M. Conversion of graded presynaptic climbing fiber activity into graded postsynaptic Ca
Oscarsson, O. Functional units of the cerebellum - sagittal zones and microzones. Trends Neurosci. 2, 143–145 (1979).
doi: 10.1016/0166-2236(79)90057-2
Ohmae, S. & Medina, J. F. Climbing fibers encode a temporal-difference prediction error during cerebellar learning in mice. Nat. Neurosci. 18, 1798–1803 (2015).
doi: 10.1038/nn.4167
pubmed: 26551541
pmcid: 4754078
Rowan, M. J. M. et al. Graded control of climbing-fiber-mediated plasticity and learning by inhibition in the cerebellum. Neuron 99, 999–1015.e6 (2018).
doi: 10.1016/j.neuron.2018.07.024
pubmed: 30122378
pmcid: 6206434
Ivry, R. B. & Keele, S. W. Timing functions of the cerebellum. J. Cogn. Neurosci 1, 136–152 (1989).
doi: 10.1162/jocn.1989.1.2.136
pubmed: 23968462
Lang, E. J. et al. The roles of the olivocerebellar pathway in motor learning and motor control. A consensus paper. Cerebellum 16, 230–252 (2017).
doi: 10.1007/s12311-016-0787-8
pubmed: 27193702
pmcid: 5116294
Ten Brinke, M. M., Boele, H. J. & De Zeeuw, C. I. Conditioned climbing fiber responses in cerebellar cortex and nuclei. Neurosci. Lett. 688, 26–36 (2019).
doi: 10.1016/j.neulet.2018.04.035
pubmed: 29689340
Giovannucci, A. et al. Cerebellar granule cells acquire a widespread predictive feedback signal during motor learning. Nat. Neurosci. 20, 727–734 (2017).
doi: 10.1038/nn.4531
pubmed: 28319608
pmcid: 5704905
Sutton, R. S. Learning to predict by methods of temporal differences. Mach. Learn. 3, 9–44 (1988).
Schultz, W., Dayan, P. & Montague, P. R. A neural substrate of prediction and reward. Science 275, 1593–1599 (1997).
doi: 10.1126/science.275.5306.1593
pubmed: 9054347
Watabe-Uchida, M., Eshel, N. & Uchida, N. Neural circuitry of reward prediction error. Annu. Rev. Neurosci. 40, 373–394 (2017).
doi: 10.1146/annurev-neuro-072116-031109
pubmed: 28441114
pmcid: 6721851
Turecek, J. et al. NMDA receptor activation strengthens weak electrical coupling in mammalian brain. Neuron 81, 1375–1388 (2014).
doi: 10.1016/j.neuron.2014.01.024
pubmed: 24656255
pmcid: 4266555
Mathy, A., Clark, B. A. & Häusser, M. Synaptically induced long-term modulation of electrical coupling in the inferior olive. Neuron 81, 1290–1296 (2014).
doi: 10.1016/j.neuron.2014.01.005
pubmed: 24656251
pmcid: 3988996
Lefler, Y., Yarom, Y. & Uusisaari, M. Y. Cerebellar inhibitory input to the inferior olive decreases electrical coupling and blocks subthreshold oscillations. Neuron 81, 1389–1400 (2014).
doi: 10.1016/j.neuron.2014.02.032
pubmed: 24656256
Miyazaki, K., Miyazaki, K. W. & Doya, K. Activation of dorsal raphe serotonin neurons underlies waiting for delayed rewards. J. Neurosci. 31, 469–479 (2011).
doi: 10.1523/JNEUROSCI.3714-10.2011
pubmed: 21228157
pmcid: 6623450
Garden, D. L. F., Rinaldi, A. & Nolan, M. F. Active integration of glutamatergic input to the inferior olive generates bidirectional postsynaptic potentials. J. Physiol. 595, 1239–1251 (2017).
doi: 10.1113/JP273424
pubmed: 27767209
Carta, I., Chen, C. H., Schott, A. L., Dorizan, S. & Khodakhah, K. Cerebellar modulation of the reward circuitry and social behavior. Science 363, eaav0581 (2019).
doi: 10.1126/science.aav0581
pubmed: 30655412
pmcid: 6711161
Gao, Z. et al. A cortico-cerebellar loop for motor planning. Nature 563, 113–116 (2018).
doi: 10.1038/s41586-018-0633-x
pubmed: 30333626
pmcid: 6212318
Chabrol, F. P., Blot, A. & Mrsic-Flogel, T. D. Cerebellar contribution to preparatory activity in motor neocortex. Preprint at biorXiv https://doi.org/10.1101/335703 (2018).
Chen, C. H., Fremont, R., Arteaga-Bracho, E. E. & Khodakhah, K. Short latency cerebellar modulation of the basal ganglia. Nat. Neurosci. 17, 1767–1775 (2014).
doi: 10.1038/nn.3868
pubmed: 25402853
pmcid: 4241171
Zhang, X. M. et al. Highly restricted expression of Cre recombinase in cerebellar Purkinje cells. Genesis 40, 45–51 (2004).
doi: 10.1002/gene.20062
pubmed: 15354293
Chen, T. W. et al. Ultrasensitive fluorescent proteins for imaging neuronal activity. Nature 499, 295–300 (2013).
doi: 10.1038/nature12354
pubmed: 23868258
pmcid: 3777791
Aronov, D. & Tank, D. W. Engagement of neural circuits underlying 2D spatial navigation in a rodent virtual reality system. Neuron 84, 442–456 (2014).
doi: 10.1016/j.neuron.2014.08.042
pubmed: 25374363
pmcid: 4454359
Burgess, C. P. et al. High-yield methods for accurate two-alternative visual psychophysics in head-fixed mice. Cell Rep. 20, 2513–2524 (2017).
doi: 10.1016/j.celrep.2017.08.047
pubmed: 28877482
pmcid: 5603732
Slotnick, B. A simple 2-transistor touch or lick detector circuit. J. Exp. Anal. Behav. 91, 253–255 (2009).
doi: 10.1901/jeab.2009.91-253
pubmed: 19794837
pmcid: 2648519
Jun, J. J. et al. Fully integrated silicon probes for high-density recording of neural activity. Nature 551, 232–236 (2017).
doi: 10.1038/nature24636
pubmed: 29120427
pmcid: 5955206
Pachitariu, M. et al. Suite2p: beyond 10,000 neurons with standard two-photon microscopy. Preprint at biorXiv https://doi.org/10.1101/061507 (2017).
Deneux, T. et al. Accurate spike estimation from noisy calcium signals for ultrafast three-dimensional imaging of large neuronal populations in vivo. Nat. Commun. 7, 12190 (2016).
doi: 10.1038/ncomms12190
pubmed: 27432255
pmcid: 4960309
Ozden, I., Lee, H. M., Sullivan, M. R. & Wang, S. S. Identification and clustering of event patterns from in vivo multiphoton optical recordings of neuronal ensembles. J. Neurophysiol. 100, 495–503 (2008).
doi: 10.1152/jn.01310.2007
pubmed: 18497355
pmcid: 2493472
Tsutsumi, S. et al. Structure-function relationships between aldolase C/zebrin II expression and complex spike synchrony in the cerebellum. J. Neurosci. 35, 843–852 (2015).
doi: 10.1523/JNEUROSCI.2170-14.2015
pubmed: 25589776
pmcid: 6605375
Ramirez, J. E. & Stell, B. M. Calcium imaging reveals coordinated simple spike pauses in populations of cerebellar Purkinje cells. Cell Rep. 17, 3125–3132 (2016).
doi: 10.1016/j.celrep.2016.11.075
pubmed: 28009283
Streng, M. L., Popa, L. S. & Ebner, T. J. Climbing fibers control Purkinje cell representations of behavior. J. Neurosci. 37, 1997–2009 (2017).
doi: 10.1523/JNEUROSCI.3163-16.2017
pubmed: 28077726
pmcid: 5338751
Watson, B. O., Yuste, R. & Packer, A. M. PackIO and EphysViewer: software tools for acquisition and analysis of neuroscience data. Preprint at biorXiv https://doi.org/10.1101/054080 (2016).
Pachitariu, M., Steinmetz, N. A., Kadir, S. N., Carandini, M. & Harris, K. D. Fast and accurate spike sorting of high-channel count probes with Kilosort. Adv. Neural Inf. Process. Syst. 29, 4448–4456 (2016).
Armstrong, D. M. & Rawson, J. A. Activity patterns of cerebellar cortical neurones and climbing fibre afferents in the awake cat. J. Physiol. 289, 425–448 (1979).
doi: 10.1113/jphysiol.1979.sp012745
pubmed: 458677
pmcid: 1281378
Gao, H., Solages, Cd & Lena, C. Tetrode recordings in the cerebellar cortex. J. Physiol. Paris 106, 128–136 (2012).
doi: 10.1016/j.jphysparis.2011.10.005
pubmed: 22057014
Dong, H.-W. The Allen Reference Atlas: A Digital Color Brain Atlas of the C57Bl/6J Male Mouse (Wiley, 2008).
Oh, S. W. et al. A mesoscale connectome of the mouse brain. Nature 508, 207–214 (2014).
doi: 10.1038/nature13186
pubmed: 24695228
pmcid: 5102064
Shamash, P., Carandini, M., Harris, K. & Steinmetz, N. A tool for analyzing electrode tracks from slice histology. Preprint at biorXiv https://doi.org/10.1101/447995 (2018).