Recurrent architecture for adaptive regulation of learning in the insect brain.
Journal
Nature neuroscience
ISSN: 1546-1726
Titre abrégé: Nat Neurosci
Pays: United States
ID NLM: 9809671
Informations de publication
Date de publication:
04 2020
04 2020
Historique:
received:
16
08
2019
accepted:
06
02
2020
pubmed:
24
3
2020
medline:
8
7
2020
entrez:
24
3
2020
Statut:
ppublish
Résumé
Dopaminergic neurons (DANs) drive learning across the animal kingdom, but the upstream circuits that regulate their activity and thereby learning remain poorly understood. We provide a synaptic-resolution connectome of the circuitry upstream of all DANs in a learning center, the mushroom body of Drosophila larva. We discover afferent sensory pathways and a large population of neurons that provide feedback from mushroom body output neurons and link distinct memory systems (aversive and appetitive). We combine this with functional studies of DANs and their presynaptic partners and with comprehensive circuit modeling. We find that DANs compare convergent feedback from aversive and appetitive systems, which enables the computation of integrated predictions that may improve future learning. Computational modeling reveals that the discovered feedback motifs increase model flexibility and performance on learning tasks. Our study provides the most detailed view to date of biological circuit motifs that support associative learning.
Identifiants
pubmed: 32203499
doi: 10.1038/s41593-020-0607-9
pii: 10.1038/s41593-020-0607-9
pmc: PMC7145459
mid: EMS85734
doi:
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Research Support, U.S. Gov't, Non-P.H.S.
Langues
eng
Sous-ensembles de citation
IM
Pagination
544-555Subventions
Organisme : Wellcome Trust
ID : 205050
Pays : United Kingdom
Organisme : Howard Hughes Medical Institute
Pays : United States
Organisme : Wellcome Trust
ID : RG86459
Pays : United Kingdom
Organisme : Wellcome Trust
ID : 205038/A/16/Z
Pays : United Kingdom
Organisme : Medical Research Council
ID : MC_UP_1201/20
Pays : United Kingdom
Organisme : Wellcome Trust
Pays : United Kingdom
Organisme : Wellcome Trust
ID : 205038/Z/16/Z
Pays : United Kingdom
Organisme : European Research Council
ID : 819650
Pays : International
Références
Schultz, W. Neuronal reward and decision signals: from theories to data. Physiol. Rev. 95, 853–951 (2015).
pubmed: 26109341
pmcid: 4491543
Dunsmoor, J. E., Niv, Y., Daw, N. & Phelps, E. A. Rethinking extinction. Neuron 88, 47–63 (2015).
pubmed: 26447572
pmcid: 4598943
Cognigni, P., Felsenberg, J. & Waddell, S. Do the right thing: neural network mechanisms of memory formation, expression and update in drosophila. Curr. Opin. Neurobiol. 49, 51–58 (2018).
pubmed: 29258011
pmcid: 5981003
Watabe-Uchida, M., Eshel, N. & Uchida, N. Neural circuitry of reward prediction error. Annu. Rev. Neurosci. 40, 373–394 (2017).
pubmed: 28441114
pmcid: 6721851
Menzel, R. Searching for the memory trace in a mini-brain, the honeybee. Learn. Mem. 8, 53–62 (2001).
pubmed: 11274250
Heisenberg, M. Mushroom body memoir: from maps to models. Nat. Rev. Neurosci. 4, 266–275 (2003).
pubmed: 12671643
Rescorla, R.A. & Wagner, A.R. in Classical Conditioning II: Current Research and Theory (eds Black, A.H. & Prokasy, W.F.) 64–99 (Appleton Century Crofts, 1972).
Sutton, R. S. & Barto, A. G. Reinforcement Learning: An Introduction (MIT Press, 1998).
Watabe-Uchida, M. The basal ganglia sensory system listens to prefrontal task needs. Neuron 103, 353–355 (2019).
pubmed: 31394057
Riemensperger, T., Vller, T., Stock, P., Buchner, E. & Fiala, A. Punishment prediction by dopaminergic neurons in Drosophila. Curr. Biol. 15, 1953–1960 (2005).
pubmed: 16271874
Dylla, K. V., Raiser, G., Galizia, C. G. & Szyszka, P. Trace conditioning in Drosophila induces associative plasticity in mushroom body kenyon cells and dopaminergic neurons. Front. Neural Circuits 11, 42 (2017).
pubmed: 28676744
pmcid: 5476701
Eichler, K. et al. The complete connectome of a learning and memory centre in an insect brain. Nature 548, 175–182 (2017).
pubmed: 28796202
pmcid: 5806122
Takemura, S. Y. et al. A connectome of a learning and memory center in the adult Drosophila brain. eLife 6, e26975 (2017).
pubmed: 28718765
pmcid: 5550281
Davis, R. L. Traces of Drosophila memory. Neuron 70, 8–19 (2011).
pubmed: 21482352
pmcid: 3374581
Thum, A. S. & Gerber, B. Connectomics and function of a memory network: the mushroom body of larval Drosophila. Curr. Opin. Neurobiol. 54, 146–154 (2019).
pubmed: 30368037
Handler, A. et al. Distinct dopamine receptor pathways underlie the temporal sensitivity of associative learning. Cell 178, 60–75.e19 (2019).
pubmed: 31230716
Hige, T., Aso, Y., Modi, M. N., Rubin, G. M. & Turner, G. C. Heterosynaptic plasticity underlies aversive olfactory learning in Drosophila. Neuron 88, 985–998 (2015).
pubmed: 26637800
pmcid: 4674068
Waddell, S. Reinforcement signalling in Drosophila; dopamine does it all after all. Curr. Opin. Neurobiol. 23, 324–329 (2013).
pubmed: 23391527
Aso, Y. & Rubin, G. M. Dopaminergic neurons write and update memories with cell-type-specific rules. eLife 5, e16135 (2016).
pubmed: 27441388
pmcid: 4987137
Liu, C. et al. A subset of dopamine neurons signals reward for odour memory in Drosophila. Nature 488, 512–516 (2012).
pubmed: 22810589
Schroll, C. et al. Light-induced activation of distinct modulatory neurons triggers appetitive or aversive learning in Drosophila larvae. Curr. Biol. 16, 1741–1747 (2006).
pubmed: 16950113
Saumweber, T. et al. Functional architecture of reward learning in mushroom body extrinsic neurons of larval Drosophila. Nat. Commun. 9, 1104 (2018).
pubmed: 29549237
pmcid: 5856778
Caldwell, J. C., Miller, M. M., Wing, S., Soll, D. R. & Eberl, D. F. Dynamic analysis of larval locomotion in Drosophila chordotonal organ mutants. Proc. Natl Acad. Sci. USA 100, 16053–16058 (2003).
pubmed: 14673076
Tracey, W., Wilson, R., Laurent, G. & Benzer, S. painless, a Drosophila gene essential for nociception. Cell 113, 261–273 (2003).
pubmed: 12705873
Ohyama, T. et al. High-throughput analysis of stimulus-evoked behaviors in Drosophila larva reveals multiple modality-specific escape strategies. PLoS One 8, e71706 (2013).
pubmed: 23977118
pmcid: 3748116
Ohyama, T. et al. A multilevel multimodal circuit enhances action selection in Drosophila. Nature 520, 633–639 (2015).
pubmed: 25896325
Jovanic, T. et al. Competitive disinhibition mediates behavioral choice and sequences in Drosophila. Cell 167, 858–870.e19 (2016).
pubmed: 27720450
Eschbach, C. et al. Associative learning between odorants and mecha nosensory punishment in larval Drosophila. J. Exp. Biol. 214, 3897–3905 (2011).
pubmed: 22071180
Liu, W. W. & Wilson, R. I. Glutamate is an inhibitory neurotransmitter in the Drosophila olfactory system. Proc. Natl Acad. Sci. USA 110, 10294–10299 (2013).
pubmed: 23729809
Fushiki, A. et al. A circuit mechanism for the propagation of waves of muscle contraction in Drosophila. eLife 5, e13253 (2016).
pubmed: 26880545
pmcid: 4829418
Jiang, L. & Litwin-Kumar, A. Models of heterogeneous dopamine signaling in an insect learning and memory center. Preprint at bioRxiv https://doi.org/10.1101/737064 (2019).
Mancini, N. et al. Reversal learning in Drosophila larvae. Learn. Mem. 26, 424–435 (2019).
pubmed: 31615854
Felsenberg, J. et al. Integration of parallel opposing memories underlies memory extinction. Cell 175, 709–722.e15 (2018).
pubmed: 30245010
pmcid: 6198041
Tabone, C. J. & de Belle, J. S. Second-order conditioning in Drosophila. Learn. Mem. 18, 250–253 (2011).
pubmed: 21441302
pmcid: 3072777
Brembs, B. & Wiener, J. Context and occasion setting in Drosophila visual learning. Learn. Mem. 13, 618–628 (2006).
pubmed: 17015858
pmcid: 1783616
Schultz, W., Dayan, P. & Montague, P. R. A neural substrate of prediction and reward. Science 275, 1593–1599 (1997).
pubmed: 9054347
Zhao, X., Lenek, D., Dag, U., Dickson, B. J. & Keleman, K. Persistent activity in a recurrent circuit underlies courtship memory in Drosophila. eLife 7, e31425 (2018).
pubmed: 29322941
pmcid: 5800849
Cohn, R., Morantte, I. & Ruta, V. Coordinated and compartmentalized neuromodulation shapes sensory processing in Drosophila. Cell 163, 1742–1755 (2015).
pubmed: 26687359
pmcid: 4732734
Ichinose, T. et al. Reward signal in a recurrent circuit drives appetitive long-term memory formation. eLife 4, 1–18 (2015).
Ueoka, Y., Hiroi, M., Abe, T. & Tabata, T. Suppression of a single pair of mushroom body output neurons in Drosophila triggers aversive associations. FEBS Open Bio. 7, 562–576 (2017).
pubmed: 28396840
pmcid: 5377409
Felsenberg, J., Barnstedt, O., Cognigni, P., Lin, S. & Waddell, S. Re-evaluation of learned information in Drosophila. Nature 544, 240–244 (2017).
pubmed: 28379939
pmcid: 5392358
Pavlowsky, A., Schor, J., Placais, P. Y. & Preat, T. A gabaergic feedback shapes dopaminergic input on the Drosophila mushroom body to promote appetitive long-term memory. Curr. Biol. 28, 1783.e4–1793.e4 (2018).
König, C., Khalili, A., Niewalda, T., Gao, S. & Gerber, B. An optogenetic analogue of second-order reinforcement in Drosophila. Biol. Lett. 15, 20190084 (2019).
pubmed: 31266421
pmcid: 6684970
Lyutova, R. et al. Reward signaling in a recurrent circuit of dopaminergic neurons and peptidergic kenyon cells. Nat. Commun. 10, 3097 (2019).
pubmed: 31308381
pmcid: 6629635
Tian, J. et al. Distributed and mixed information in monosynaptic inputs to dopamine neurons. Neuron 91, 1374–1389 (2016).
pubmed: 27618675
pmcid: 5033723
Beier, K. T. et al. Circuit architecture of vta dopamine neurons revealed by systematic input-output mapping. Cell 162, 622–634 (2015).
pubmed: 26232228
pmcid: 4522312
Haber, S. N., Fudge, J. L. & McFarland, N. R. Striatonigrostriatal pathways in primates form an ascending spiral from the shell to the dorsolateral striatum. J. Neurosci. 20, 2369–2382 (2000).
pubmed: 10704511
pmcid: 6772499
Watabe-Uchida, M., Zhu, L., Ogawa, S. K., Vamanrao, A. & Uchida, N. Whole-brain mapping of direct inputs to midbrain dopamine neurons. Neuron 74, 858–873 (2012).
pubmed: 22681690
Menegas, W. et al. Dopamine neurons projecting to the posterior striatum form an anatomically distinct subclass. eLife 4, e10032 (2015).
pubmed: 26322384
pmcid: 4598831
Pfeiffer, B. D. et al. Refinement of tools for targeted gene expression in Drosophila. Genetics 186, 735–755 (2010).
pubmed: 20697123
pmcid: 2942869
Klapoetke, N. C. et al. Independent optical excitation of distinct neural populations. Nat. Methods 11, 338–346 (2014).
pubmed: 24509633
pmcid: 3943671
Chen, T. W. et al. Ultrasensitive fluorescent proteins for imaging neuronal activity. Nature 499, 295–300 (2013).
pubmed: 23868258
pmcid: 3777791
Luan, H., Peabody, N. C., Vinson, C. R. & White, B. H. Refined spatial manipulation of neuronal function by combinatorial restriction of transgene expression. Neuron 52, 425–436 (2006).
pubmed: 17088209
pmcid: 1713190
Jenett, A. et al. A GAL4-driver line resource for Drosophila neurobiology. Cell Rep. 2, 991–1001 (2012).
pubmed: 23063364
pmcid: 3515021
Aso, Y. et al. The neuronal architecture of the mushroom body provides a logic for associative learning. eLife 3, e04577 (2014).
pubmed: 25535793
pmcid: 4273437
Vogelstein, J. T. et al. Discovery of brainwide neural-behavioral maps via multiscale unsupervised structure learning. Science 344, 386–392 (2014).
pubmed: 24674869
Yang, C. H. et al. Control of the postmating behavioral switch in Drosophila females by internal sensory neurons. Neuron 61, 519–526 (2009).
pubmed: 19249273
pmcid: 2748846
Awasaki, T., Huang, Y., O’Connor, M. B. & Lee, T. Glia instruct developmental neuronal remodeling through tgf-beta signaling. Nat. Neurosci. 14, 821–823 (2011).
pubmed: 21685919
pmcid: 3337551
Liu, C. et al. A subset of dopamine neurons signals reward for odour memory in Drosophila. Nature 488, 512–516 (2012).
pubmed: 22810589
Pfeiffer, B. D., Truman, J. W. & Rubin, G. M. Using translational enhancers to increase transgene expression in Drosophila. Proc. Natl Acad. Sci. USA 109, 6626–6631 (2012).
pubmed: 22493255
Rohwedder, A. et al. Four individually identified paired dopamine neurons signal reward in larval Drosophila. Curr. Biol. 26, 661–669 (2016).
pubmed: 26877086
Suloway, C. et al. Automated molecular microscopy: the new leginon system. J. Struct. Biol. 151, 41–60 (2005).
pubmed: 15890530
Cardona, A. et al. Trakem2 software for neural circuit reconstruction. PLoS ONE 7, e38011 (2012).
pubmed: 22723842
pmcid: 3378562
Saalfeld, S., Fetter, R., Cardona, A. & Tomancak, P. Elastic volume reconstruction from series of ultra-thin microscopy sections. Nat. Methods 9, 717–720 (2012).
pubmed: 22688414
Saalfeld, S., Cardona, A., Hartenstein, V. & Tomancak, P. CATMAID: collaborative annotation toolkit for massive amounts of image data. Bioinformatics 25, 1984–1986 (2009).
pubmed: 19376822
pmcid: 2712332
Schneider-Mizell, C. M. et al. Quantitative neuroanatomy for connectomics in Drosophila. eLife 5, e12059 (2016).
pubmed: 26990779
pmcid: 4811773
Berck, M. E. et al. The wiring diagram of a glomerular olfactory system. eLife 5, e14859 (2016).
pubmed: 27177418
pmcid: 4930330
Goodman, C. S., Bate, M. & Spitzer, N. C. Embryonic development of identified neurons: origin and transformation of the h cell. J. Neurosci. 1, 94–102 (1981).
pubmed: 7346562
pmcid: 6564154
Bate, M., Goodman, C. S. & Spitzer, N. C. Embryonic development of identified neurons: segment-specific differences in the h cell homologues. J. Neurosci. 1, 103–106 (1981).
pubmed: 7346554
pmcid: 6564157
Costa, M., Manton, J. D., Ostrovsky, A. D., Prohaska, S. & Jefferis, G. S. NBLAST: rapid, sensitive comparison of neuronal structure and construction of neuron family databases. Neuron 91, 293–311 (2016).
pubmed: 27373836
pmcid: 4961245
Schindelin, J. et al. Fiji: an open-source platform for biological-image analysis. Nat. Methods 9, 676–682 (2012).
Daniels, R. W., Gelfand, M. V., Collins, C. A. & DiAntonio, A. Visualizing glutamatergic cell bodies and synapses in drosophila larval and adult CNS. J. Comp. Neurol. 508, 131–152 (2008).
pubmed: 18302156
Nern, A., Pfeiffer, B. D. & Rubin, G. M. Optimized tools for multicolor stochastic labeling reveal diverse stereotyped cell arrangements in the fly visual system. Proc. Natl Acad. Sci. USA 112, E2967–E2976 (2015).
pubmed: 25964354
Li, H. H. et al. A GAL4 driver resource for developmental and behavioral studies on the larval CNS of Drosophila. Cell Rep. 8, 897–908 (2014).
pubmed: 25088417
Selcho, M., Pauls, D., Han, K. A., Stocker, R. F. & Thum, A. S. The role of dopamine in Drosophila larval classical olfactory conditioning. PLoS ONE 4, e5897 (2009).
pubmed: 19521527
pmcid: 2690826
Selcho, M., Pauls, D., Huser, A., Stocker, R. F. & Thum, A. S. Characterization of the octopaminergic and tyraminergic neurons in the central brain of Drosophila larvae. J. Comp. Neurol. 522, 3485–3500 (2014).
pubmed: 24752702
Pauls, D., Selcho, M., Gendre, N., Stocker, R. F. & Thum, A. S. Drosophila larvae establish appetitive olfactory memories via mushroom body neurons of embryonic origin. J. Neurosci. 30, 10655–10666 (2010).
pubmed: 20702697
pmcid: 6634688
Marley, R. & Baines, R.A. Dissection of third-instar Drosophila larvae for electrophysiological recording from neurons. Cold Spring Harb. Protoc. 2011, pdb.prot065656 (2011).
pubmed: 21880808