Organization of reward and movement signals in the basal ganglia and cerebellum.
Journal
Nature communications
ISSN: 2041-1723
Titre abrégé: Nat Commun
Pays: England
ID NLM: 101528555
Informations de publication
Date de publication:
08 Mar 2024
08 Mar 2024
Historique:
received:
05
11
2022
accepted:
06
02
2024
medline:
9
3
2024
pubmed:
9
3
2024
entrez:
8
3
2024
Statut:
epublish
Résumé
The basal ganglia and the cerebellum are major subcortical structures in the motor system. The basal ganglia have been cast as the reward center of the motor system, whereas the cerebellum is thought to be involved in adjusting sensorimotor parameters. Recent findings of reward signals in the cerebellum have challenged this dichotomous view. To compare the basal ganglia and the cerebellum directly, we recorded from oculomotor regions in both structures from the same monkeys. We partitioned the trial-by-trial variability of the neurons into reward and eye-movement signals to compare the coding across structures. Reward expectation and movement signals were the most pronounced in the output structure of the basal ganglia, intermediate in the cerebellum, and the smallest in the input structure of the basal ganglia. These findings suggest that reward and movement information is sharpened through the basal ganglia, resulting in a higher signal-to-noise ratio than in the cerebellum.
Identifiants
pubmed: 38459003
doi: 10.1038/s41467-024-45921-9
pii: 10.1038/s41467-024-45921-9
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
2119Subventions
Organisme : EC | EU Framework Programme for Research and Innovation H2020 | H2020 Priority Excellent Science | H2020 European Research Council (H2020 Excellent Science - European Research Council)
ID : 755745
Organisme : Israel Science Foundation (ISF)
ID : 380/17
Informations de copyright
© 2024. The Author(s).
Références
Wagner, M. J., Kim, T. H., Savall, J., Schnitzer, M. J. & Luo, L. Cerebellar granule cells encode the expectation of reward. Nature 544, 96–100 (2017).
pubmed: 28321129
pmcid: 5532014
doi: 10.1038/nature21726
Schultz, W. Predictive reward signal of dopamine neurons. J. Neurophysiol. 80, 1–27 (1998).
Lixenberg, A., Yarkoni, M., Botschko, Y. & Joshua, M. Encoding of eye movements explains reward-related activity in cerebellar simple spikes. J. Neurophysiol. 123, 786–799 (2020).
pubmed: 31940216
pmcid: 7052631
doi: 10.1152/jn.00363.2019
Doya, K. Complementary roles of basal ganglia and cerebellum in learning and motor control. Curr. Opin. Neurobiol. 10, 732–739 (2000).
pubmed: 11240282
doi: 10.1016/S0959-4388(00)00153-7
Schultz, W., Dayan, P. & Montague, P. R. A neural substrate of prediction and reward. Science (1979) 275, 1593–1599 (1997).
Albus, J. S. A theory of cerebellar function. Math. Biosci. 10, 25–61 (1971).
doi: 10.1016/0025-5564(71)90051-4
Marr, D. A theory of cerebellar cortex. J. Physiol. 202, 437–470 (1969).
pubmed: 5784296
pmcid: 1351491
doi: 10.1113/jphysiol.1969.sp008820
Heffley, W. et al. Coordinated cerebellar climbing fiber activity signals learned sensorimotor predictions. Nat. Neurosci. 21, 1431–1441 (2018).
pubmed: 30224805
pmcid: 6362851
doi: 10.1038/s41593-018-0228-8
Heffley, W. & Hull, C. Classical conditioning drives learned reward prediction signals in climbing fibers across the lateral cerebellum. Elife 8, e46764 (2019).
pubmed: 31509108
pmcid: 6845228
doi: 10.7554/eLife.46764
Kostadinov, D., Beau, M., Pozo, M. B. & Häusser, M. Predictive and reactive reward signals conveyed by climbing fiber inputs to cerebellar Purkinje cells. Nat. Neurosci. 22, 950–962 (2019).
pubmed: 31036947
pmcid: 7612392
doi: 10.1038/s41593-019-0381-8
Larry, N., Yarkoni, M., Lixenberg, A. & Joshua, M. Cerebellar climbing fibers encode expected reward size. Elife 8, 1–16 (2019).
doi: 10.7554/eLife.46870
Carta, I., Chen, C. H., Schott, A. L., Dorizan, S. & Khodakhah, K. Cerebellar modulation of the reward circuitry and social behavior. Science 363, eaav0581 (2019).
pubmed: 30655412
pmcid: 6711161
doi: 10.1126/science.aav0581
Kameda, M., Ohmae, S. & Tanaka, M. Entrained neuronal activity to periodic visual stimuli in the primate striatum compared with the cerebellum. Elife 8, e48702 (2019).
pubmed: 31490120
pmcid: 6748823
doi: 10.7554/eLife.48702
Kameda, M., Niikawa, K., Uematsu, A. & Tanaka, M. Sensory and motor representations of internalized rhythms in the cerebellum and basal ganglia. Proc. Natl Acad. Sci. 120, e2221641120 (2023).
pubmed: 37276394
pmcid: 10268275
doi: 10.1073/pnas.2221641120
Raghavan, R. T. & Lisberger, S. G. Responses of Purkinje cells in the oculomotor vermis of monkeys during smooth pursuit eye movements and saccades: Comparison with floccular complex. J. Neurophysiol. 118, 986–1001 (2017).
pubmed: 28515286
pmcid: 5539460
doi: 10.1152/jn.00209.2017
Hikosaka, O. & Wurtz, R. H. Visual and oculomotor functions of monkey substantia nigra pars reticulata. IV. Relation of substantia nigra to superior colliculus. J. Neurophysiol. 49, 1285–1301 (1983).
pubmed: 6306173
doi: 10.1152/jn.1983.49.5.1285
Hikosaka, O., Sakamoto, M. & Usui, S. Functional properties of monkey caudate neurons. I. Activities related to saccadic eye movements. J. Neurophysiol. 61, 780–798 (1989).
pubmed: 2723720
doi: 10.1152/jn.1989.61.4.780
Krauzlis, R. J. Recasting the smooth pursuit eye movement system. J. Neurophysiol. 91, 591–603 (2004).
Keller, E. L., Slakey, D. P. & Crandall, W. F. Microstimulation of the primate cerebellar vermis during saccadic eye movements. Brain Res. 288, 131–143 (1983).
pubmed: 6661614
doi: 10.1016/0006-8993(83)90087-2
Krauzlis, R. J. & Miles, F. A. Role of the oculomotor vermis in generating pursuit and saccades: effects of microstimulation. J. Neurophysiol. 80, 2046–2062 (1998).
pubmed: 9772260
doi: 10.1152/jn.1998.80.4.2046
Noda, H. & Fujikado, T. Topography of the oculomotor area of the cerebellar vermis in macaques as determined by microstimulation. J. Neurophysiol. 58, 359–378 (1987).
pubmed: 3655873
doi: 10.1152/jn.1987.58.2.359
Nakamura, K. & Hikosaka, O. Facilitation of saccadic eye movements by postsaccadic electrical stimulation in the primate caudate. J. Neurosci. 26, 12885–12895 (2006).
pubmed: 17167079
pmcid: 6674951
doi: 10.1523/JNEUROSCI.3688-06.2006
Basso, M. A. & Liu, P. Context-dependent effects of substantia nigra stimulation on eye movements. J. Neurophysiol. 97, 4129–4142 (2007).
pubmed: 17392414
doi: 10.1152/jn.00094.2007
Sato, M. & Hikosaka, O. Role of primate substantia nigra pars reticulata in reward-oriented saccadic eye movement. J. Neurosci. 22, 2363–2373 (2002).
pubmed: 11896175
pmcid: 6758246
doi: 10.1523/JNEUROSCI.22-06-02363.2002
Kawagoe, R., Takikawa, Y. & Hikosaka, O. Reward-predicting activity of dopamine and caudate neurons - a possible mechanism of motivational control of saccadic eye movement. J. Neurophysiol. 91, 1013–1024 (2004).
pubmed: 14523067
doi: 10.1152/jn.00721.2003
Hikosaka, O., Sakamoto, M. & Usui, S. Functional properties of monkey caudate neurons. III. Activities related to expectation of target and reward. J. Neurophysiol. 61, 814–832 (1989).
pubmed: 2723722
doi: 10.1152/jn.1989.61.4.814
Schmahmann, J. D. An emerging concept: the cerebellar contribution to higher function. Arch. Neurol. 48, 1178–1187 (1991).
pubmed: 1953406
doi: 10.1001/archneur.1991.00530230086029
Schmahmann, J. D. The role of the cerebellum in affect and psychosis. J. Neurolinguist. 13, 189–214 (2000).
doi: 10.1016/S0911-6044(00)00011-7
Guell, X., Schmahmann, J. D., Gabrieli, J. D. E. & Ghosh, S. S. Functional gradients of the cerebellum. Elife 7, e36652 (2018).
pubmed: 30106371
pmcid: 6092123
doi: 10.7554/eLife.36652
Rashbass, C. The relationship between saccadic and smooth tracking eye movements. J. Physiol. 159, 326–338 (1961).
pubmed: 14490422
pmcid: 1359508
doi: 10.1113/jphysiol.1961.sp006811
Suzuki, D. A. & Keller, E. L. The role of the posterior vermis of monkey cerebellum in smooth-pursuit eye movement control. II. Target velocity-related Purkinje cell activity. J. Neurophysiol. 59, 19–40 (1988).
pubmed: 3343601
doi: 10.1152/jn.1988.59.1.19
Basso, M. A., Pokorny, J. J. & Liu, P. Activity of substantia nigra pars reticulata neurons during smooth pursuit eye movements in monkeys. Eur. J. Neurosci. 22, 448–464 (2005).
pubmed: 16045498
doi: 10.1111/j.1460-9568.2005.04215.x
Eccles, J. C., Llinás, R. & Sasaki, K. The excitatory synaptic action of climbing fibres on the Purkinje cells of the cerebellum. J. Physiol. 182, 268–296 (1966).
pubmed: 5944665
pmcid: 1357472
doi: 10.1113/jphysiol.1966.sp007824
Stone, L. S. & Lisberger, S. G. Visual responses of Purkinje cells in the cerebellar flocculus during smooth-pursuit eye movements in monkeys. II. Complex spikes. J. Neurophysiol. 63, 1262–1275 (1990).
pubmed: 2358873
doi: 10.1152/jn.1990.63.5.1262
Olejnik, S. & Algina, J. Measures of effect size for comparative studies: applications, interpretations, and limitations. Contemp. Educ. Psychol. 25, 241–286 (2000).
pubmed: 10873373
doi: 10.1006/ceps.2000.1040
Shin, S. Y. & Sommer, M. A. Activity of neurons in monkey globus pallidus during oculomotor behavior compared with that in substantia nigra pars reticulata. J. Neurophysiol. 103, 1874–1887 (2010).
pubmed: 20107133
pmcid: 2853273
doi: 10.1152/jn.00101.2009
Joshua, M., Adler, A., Rosin, B., Vaadia, E. & Bergman, H. Encoding of probabilistic rewarding and aversive events by pallidal and nigral neurons. J. Neurophysiol. 101, 758–772 (2009).
pubmed: 19052110
doi: 10.1152/jn.90764.2008
Nakamura, K. & Hikosaka, O. Role of dopamine in the primate caudate nucleus in reward modulation of saccades. J. Neurosci. 26, 5360–5369 (2006).
pubmed: 16707788
pmcid: 6675290
doi: 10.1523/JNEUROSCI.4853-05.2006
Cromwell, H. C., Hassani, O. K. & Schultz, W. Relative reward processing in primate striatum. Exp. Brain Res. 162, 520–525 (2005).
pubmed: 15754177
doi: 10.1007/s00221-005-2223-z
Zur, G., Larry, N. & Joshua, M. High-dimensional encoding of movement by single neurons in basal ganglia output. bioRxiv 2023.05.17.541090 https://doi.org/10.1101/2023.05.17.541090 . (2023).
Churchland, M. M. et al. Neural population dynamics during reaching. https://doi.org/10.1038/nature11129 . (2012).
Krauzlis, R. J. Activity of rostral superior colliculus neurons during passive and active viewing of motion. J. Neurophysiol. 92, 949–958 (2004).
pubmed: 15028744
doi: 10.1152/jn.00830.2003
Arkadir, D., Morris, G., Vaadia, E. & Bergman, H. Behavioral/systems/cognitive independent coding of movement direction and reward prediction by single pallidal neurons. https://doi.org/10.1523/JNEUROSCI.2583-04.2004 . (2004).
Raghavan, R. T. & Joshua, M. Dissecting patterns of preparatory activity in the frontal eye fields during pursuit target selection. J. Neurophysiol. 118, 2216–2231 (2017).
pubmed: 28724782
pmcid: 5626896
doi: 10.1152/jn.00317.2017
Martinez-Trujillo, J. C. & Treue, S. Feature-based attention increases the selectivity of population responses in primate visual cortex. Curr. Biol. 14, 744–751 (2004).
pubmed: 15120065
doi: 10.1016/j.cub.2004.04.028
Kostadinov, D. & Hausser, M. Reward signals in the cerebellum: origins, targets, and functional implications. Neuron 110, 1290–1303 (2022).
pubmed: 35325616
doi: 10.1016/j.neuron.2022.02.015
Sendhilnathan, N. et al. Neural correlates of reinforcement learning in mid-lateral cerebellum. Neuron 106, 1–11 (2020).
doi: 10.1016/j.neuron.2019.12.032
Fiorillo, C. D., Tobler, P. N. & Schultz, W. Discrete coding of reward probability and uncertainty by dopamine neurons. Science (1979) 299, 1898–1902 (2003).
Morris, G., Arkadir, D., Nevet, A., Vaadia, E. & Bergman, H. Coincident but distinct messages of midbrain dopamine and striatal tonically active neurons. Neuron 43, 133–143 (2004).
pubmed: 15233923
doi: 10.1016/j.neuron.2004.06.012
Sutton, R. S. & Barto, A. G. Reinforcement learning: an introduction. IEEE Trans. Neural Netw. https://doi.org/10.1109/tnn.1998.712192 . (1998).
Prsa, M., Dash, S., Catz, N., Dicke, P. W. & Thier, P. Characteristics of responses of Golgi cells and mossy fibers to eye saccades and saccadic adaptation recorded from the posterior vermis of the cerebellum. J. Neurosci. 29, 250–262 (2009).
pubmed: 19129401
pmcid: 6664902
doi: 10.1523/JNEUROSCI.4791-08.2009
Joshua, M., Medina, J. F. & Lisberger, S. G. Diversity of neural responses in the brainstem during smooth pursuit eye movements constrains the circuit mechanisms of neural integration. J. Neurosci. 33, 6633–6647 (2013).
pubmed: 23575860
pmcid: 3705570
doi: 10.1523/JNEUROSCI.3732-12.2013
Sparks, D. L. The brainstem control of saccadic eye movements. Nat. Rev. Neurosci. 3, 952–964 (2002). 2002 3:12.
pubmed: 12461552
doi: 10.1038/nrn986
Robinson, D. A. The use of control systems analysis in the neurophysiology of eye movements. Annu. Rev. Neurosci. 4, 463–503 (1981).
pubmed: 7013640
doi: 10.1146/annurev.ne.04.030181.002335
Shalit, U., Zinger, N., Joshua, M. & Prut, Y. Descending systems translate transient cortical commands into a sustained muscle activation signal. Cereb. Cortex 22, 1904–1914 (2012).
pubmed: 21965441
doi: 10.1093/cercor/bhr267
Kaufman, M. T., Churchland, M. M., Ryu, S. I. & Shenoy, K. V. Cortical activity in the null space: permitting preparation without movement. Nat. Neurosci. 17, 440–448 (2014).
pubmed: 24487233
pmcid: 3955357
doi: 10.1038/nn.3643
Bar-Gad, I., Morris, G. & Bergman, H. Information processing, dimensionality reduction and reinforcement learning in the basal ganglia. Prog. Neurobiol. 71, 439–473 (2003).
pubmed: 15013228
doi: 10.1016/j.pneurobio.2003.12.001
Bar-Gad, I., Goldberg, J. A., Bergman, H., Havazelet-Heimer, G. & Ruppin, E. Reinforcement-driven dimensionality reduction- a model for information processing in the Basal Ganglia. J. Basic Clin. Physiol. Pharm. 11, 305–320 (2000).
doi: 10.1515/JBCPP.2000.11.4.305
Nambu, A. et al. Excitatory conical inputs to pallidal neurons via the subthalamic nucleus in the monkey. J. Neurophysiol. 84, 289–300 (2000).
pubmed: 10899204
doi: 10.1152/jn.2000.84.1.289
Zohary, E., Shadlen, M. N. & Newsome, W. T. Correlated neuronal discharge rate and its implications for psychophysical performance. Nature 370, 140–143 (1994).
pubmed: 8022482
doi: 10.1038/370140a0
Moreno-Bote, R. et al. Information-limiting correlations. Nat. Neurosci. 17, 1410–1417 (2014).
pubmed: 25195105
pmcid: 4486057
doi: 10.1038/nn.3807
Larry, N. & Joshua, M. Attenuation of noise correlations in the transformation from the frontal eye field to movement. J. Neurophysiol. (2023)
Jörntell, H. & Ekerot, C. F. Receptive field plasticity profoundly alters the cutaneous parallel fiber synaptic input to cerebellar interneurons in vivo. J. Neurosci. 23, 9620–9631 (2003).
pubmed: 14573542
pmcid: 6740478
doi: 10.1523/JNEUROSCI.23-29-09620.2003
Crook, J. D., Hendrickson, A., Erickson, A., Possin, D. & Robinson, F. R. Purkinje cell axon collaterals terminate on Cat-301+ neurons in macaca monkey cerebellum. Neuroscience 149, 834 (2007).
pubmed: 17936513
doi: 10.1016/j.neuroscience.2007.08.030
Hirono, M. et al. Cerebellar globular cells receive monoaminergic excitation and monosynaptic inhibition from Purkinje cells. PLoS One 7, e29663 (2012).
pubmed: 22235322
pmcid: 3250469
doi: 10.1371/journal.pone.0029663
Guo, C., Rudolph, S., Neuwirth, M. E. & Regehr, W. G. Purkinje cell outputs selectively inhibit a subset of unipolar brush cells in the input layer of the cerebellar cortex. Elife 10, e68802 (2021).
pubmed: 34369877
pmcid: 8352585
doi: 10.7554/eLife.68802
Witter, L., Rudolph, S., Pressler, R. T., Lahlaf, S. I. & Regehr, W. G. Purkinje cell collaterals enable output signals from the cerebellar cortex to feed back to Purkinje cells and interneurons. Neuron 91, 312–319 (2016).
pubmed: 27346533
pmcid: 4969194
doi: 10.1016/j.neuron.2016.05.037
Ashmore, R. C. & Sommer, M. A. Delay activity of saccade-related neurons in the caudal dentate nucleus of the macaque cerebellum. J. Neurophysiol. 109, 2129–2144 (2013).
pubmed: 23365182
pmcid: 3628037
doi: 10.1152/jn.00906.2011
Sendhilnathan, N., Goldberg, M. E. & Ipata, A. E. Mixed selectivity in the cerebellar Purkinje-cell response during visuomotor association learning. J. Neurosci. 42, 3847–3855 (2022).
pubmed: 35351828
pmcid: 9087720
doi: 10.1523/JNEUROSCI.1771-21.2022
Schultz, W. Reward functions of the basal ganglia. J. Neural Transm. 123, 679–693 (2016).
Joshua, M., Adler, A., Mitelman, R., Vaadia, E. & Bergman, H. Midbrain dopaminergic neurons and striatal cholinergic interneurons encode the difference between reward and aversive events at different epochs of probabilistic classical conditioning trials. J. Neurosci. 28, 11673–11684 (2008).
pubmed: 18987203
pmcid: 6671303
doi: 10.1523/JNEUROSCI.3839-08.2008
Schultz, W. Activity of pars reticulata neurons of monkey substantia nigra in relation to motor, sensory, and complex events. J. Neurophysiol. 55, 660–677 (1986).
pubmed: 3701399
doi: 10.1152/jn.1986.55.4.660
Zur, G. & Joshua, M. Using extracellular low frequency signals to improve the spike sorting of cerebellar complex spikes. J. Neurosci. Methods 328, 108423 (2019).
pubmed: 31494185
doi: 10.1016/j.jneumeth.2019.108423
Sedaghat-Nejad, E. et al. P-sort: an open-source software for cerebellar neurophysiology 3 4. https://doi.org/10.1101/2021.03.16.435644 .
Joshua, M. & Lisberger, S. G. Reward action in the initiation of smooth pursuit eye movements. J. Neurosci. 32, 2856–2867 (2012).
pubmed: 22357868
pmcid: 3327477
doi: 10.1523/JNEUROSCI.4676-11.2012
Lixenberg, A. & Joshua, M. Encoding of reward and decoding movement from the frontal eye field during smooth pursuit eye movements. J. Neurosci. 38, 10515–10524 (2018).
pubmed: 30355635
pmcid: 6596260
doi: 10.1523/JNEUROSCI.1654-18.2018
Olejnik, S. & Algina, J. Generalized eta and omega squared statistics: measures of effect size for some common research designs. Psychol. Methods 8, 434–447 (2003).
pubmed: 14664681
doi: 10.1037/1082-989X.8.4.434
Okada, K. Is omega squared less biased? A comparison of three major effect size indices in one-way anova. Behaviormetrika 40, 129–147 (2013).
doi: 10.2333/bhmk.40.129
Langsrud, Ø. ANOVA for unbalanced data: use Type II instead of Type III sums of squares. Stat. Comput. 13, 163–167 (2003).
doi: 10.1023/A:1023260610025
Larry, N., Zur, G. & Joshua, M. Organization of reward and movement signals in the basal ganglia and cerebellum. Dryad. https://doi.org/10.5061/dryad.73n5tb33r . (2023).
Larry, N., Zur, G. & Joshua, M. Organization of reward and movement signals in the basal ganglia and cerebellum. Albert-analysis https://doi.org/10.5281/zenodo.10252467 . (2023).