EthoLoop: automated closed-loop neuroethology in naturalistic environments.
Journal
Nature methods
ISSN: 1548-7105
Titre abrégé: Nat Methods
Pays: United States
ID NLM: 101215604
Informations de publication
Date de publication:
10 2020
10 2020
Historique:
received:
16
09
2019
accepted:
24
08
2020
pubmed:
1
10
2020
medline:
7
1
2021
entrez:
30
9
2020
Statut:
ppublish
Résumé
Accurate tracking and analysis of animal behavior is crucial for modern systems neuroscience. However, following freely moving animals in naturalistic, three-dimensional (3D) or nocturnal environments remains a major challenge. Here, we present EthoLoop, a framework for studying the neuroethology of freely roaming animals. Combining real-time optical tracking and behavioral analysis with remote-controlled stimulus-reward boxes, this system allows direct interactions with animals in their habitat. EthoLoop continuously provides close-up views of the tracked individuals and thus allows high-resolution behavioral analysis using deep-learning methods. The behaviors detected on the fly can be automatically reinforced either by classical conditioning or by optogenetic stimulation via wirelessly controlled portable devices. Finally, by combining 3D tracking with wireless neurophysiology we demonstrate the existence of place-cell-like activity in the hippocampus of freely moving primates. Taken together, we show that the EthoLoop framework enables interactive, well-controlled and reproducible neuroethological studies in large-field naturalistic settings.
Identifiants
pubmed: 32994566
doi: 10.1038/s41592-020-0961-2
pii: 10.1038/s41592-020-0961-2
doi:
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
1052-1059Références
Tinbergen, N The Study of Instinct 195 (Clarendon Press, 1951).
Krakauer, J. W., Ghazanfar, A. A., Gomez-Marin, A., MacIver, M. A. & Poeppel, D. Neuroscience needs behavior: correcting a reductionist bias. Neuron 93, 480–490 (2017).
pubmed: 28182904
Huber, F. & Markl, H. (eds) Neuroethology and Behavioral Physiology: Roots and Growing Points (Springer, 1983).
Hölscher, C., Schnee, A., Dahmen, H., Setia, L. & Mallot, H. A. Rats are able to navigate in virtual environments. J. Exp. Biol. 208, 561–569 (2005).
pubmed: 15671344
Dombeck, D. A., Harvey, C. D., Tian, L., Looger, L. L. & Tank, D. W. Functional imaging of hippocampal place cells at cellular resolution during virtual navigation. Nat. Neurosci. 13, 1433–1440 (2010).
pubmed: 20890294
pmcid: 2967725
Keller, G. B., Bonhoeffer, T. & Hübener, M. Sensorimotor mismatch signals in primary visual cortex of the behaving mouse. Neuron 74, 809–815 (2012).
pubmed: 22681686
Harvey, C. D., Collman, F., Dombeck, D. A. & Tank, D. W. Intracellular dynamics of hippocampal place cells during virtual navigation. Nature 461, 941–946 (2009).
pubmed: 19829374
pmcid: 2771429
Minderer, M., Harvey, C. D., Donato, F. & Moser, E. I. Neuroscience: virtual reality explored. Nature 533, 324–325 (2016).
pubmed: 27193673
Aghajan, Z. M. et al. Impaired spatial selectivity and intact phase precession in two-dimensional virtual reality. Nat. Neurosci. 18, 121–128 (2015).
pubmed: 25420065
Aronov, D. & Tank, D. W. Engagement of neural circuits underlying 2D spatial navigation in a rodent virtual reality system. Neuron 84, 442–456 (2014).
pubmed: 25374363
pmcid: 4454359
Stowers, J. R. et al. Virtual reality for freely moving animals. Nat. Methods 14, 995–1002 (2017).
pubmed: 28825703
pmcid: 6485657
Dombeck, D. A., Khabbaz, A. N., Collman, F., Adelman, T. L. & Tank, D. W. Imaging large-scale neural activity with cellular resolution in awake, mobile mice. Neuron 56, 43–57 (2007).
pubmed: 17920014
pmcid: 2268027
Sofroniew, N. J., Cohen, J. D., Lee, A. K. & Svoboda, K. Natural whisker-guided behavior by head-fixed mice in tactile virtual reality. J. Neurosci. 34, 9537–9550 (2014).
pubmed: 25031397
pmcid: 4099538
Radvansky, B. A. & Dombeck, D. A. An olfactory virtual reality system for mice. Nat. Commun. 9, 839 (2018).
pubmed: 29483530
pmcid: 5827522
Fry, S. N., Bichsel, M., Müller, P. & Robert, D. Tracking of flying insects using pan-tilt cameras. J. Neurosci. Methods 101, 59–67 (2000).
pubmed: 10967362
Fry, S. N., Rohrseitz, N., Straw, A. D. & Dickinson, M. H. TrackFly: virtual reality for a behavioral system analysis in free-flying fruit flies. J. Neurosci. Methods 171, 110–117 (2008).
pubmed: 18405978
Straw, A. D., Branson, K., Neumann, T. R. & Dickinson, M. H. Multi-camera real-time three-dimensional tracking of multiple flying animals. J. R. Soc. Interface 8, 395–409 (2011).
pubmed: 20630879
Bath, D. E. et al. FlyMAD: rapid thermogenetic control of neuronal activity in freely walking Drosophila. Nat. Methods 11, 756–762 (2014).
pubmed: 24859752
Romero-Ferrero, F., Bergomi, M. G., Hinz, R. C., Heras, F. J. H. & de Polavieja, G. G. idtracker.ai: tracking all individuals in small or large collectives of unmarked animals. Nat. Methods 16, 179–182 (2019).
pubmed: 30643215
Weissbrod, A. et al. Automated long-term tracking and social behavioural phenotyping of animal colonies within a semi-natural environment. Nat. Commun. 4, 2018 (2013).
pubmed: 23771126
de Chaumont, F. et al. Computerized video analysis of social interactions in mice. Nat. Methods 9, 410–417 (2012).
pubmed: 22388289
Matsumoto, J. et al. A 3D-video-based computerized analysis of social and sexual interactions in rats. PLoS ONE 8, e78460 (2013).
pubmed: 24205238
pmcid: 3813688
Ballesta, S., Reymond, G., Pozzobon, M. & Duhamel, J.-R. A real-time 3D video tracking system for monitoring primate groups. J. Neurosci. Methods 234, 147–152 (2014).
pubmed: 24875622
Khan, Z., Herman, R. A., Wallen, K. & Balch, T. An outdoor 3-D visual tracking system for the study of spatial navigation and memory in rhesus monkeys. Behav. Res. Methods 37, 453–463 (2005).
pubmed: 16405140
Tsoar, A. et al. Large-scale navigational map in a mammal. Proc. Natl Acad. Sci. USA 108, E718–E724 (2011).
pubmed: 21844350
Yartsev, M. M. & Ulanovsky, N. Representation of three-dimensional space in the hippocampus of flying bats. Science 340, 367–372 (2013).
pubmed: 23599496
Hong, W. et al. Automated measurement of mouse social behaviors using depth sensing, video tracking, and machine learning. Proc. Natl Acad. Sci. USA 112, E5351–E5360 (2015).
pubmed: 26354123
Shemesh, Y. et al. Correction: high-order social interactions in groups of mice. eLife 3, e03602 (2014).
pubmed: 24920500
pmcid: 4052486
De Chaumont, F. et al. Real-time analysis of the behaviour of groups of mice via a depth-sensing camera and machine learning. Nat. Biomed. Eng. 3, 930–942 (2019).
pubmed: 31110290
Pérez-Escudero, A., Vicente-Page, J., Hinz, R. C., Arganda, S. & de Polavieja, G. G. idTracker: tracking individuals in a group by automatic identification of unmarked animals. Nat. Methods 11, 743–748 (2014).
pubmed: 24880877
Strauss, R., Schuster, S. & Götz, K. G. Processing of artificial visual feedback in the walking fruit fly Drosophila melanogaster. J. Exp. Biol. 200, 1281–1296 (1997).
pubmed: 9172415
Del Grosso, N. A., Graboski, J. J., Chen, W., Blanco-Hernández, E. & Sirota, A. Virtual reality system for freely-moving rodents. Preprint at bioRxiv https://doi.org/10.1101/161232 (2017).
Buccino, A. P. et al. Open source modules for tracking animal behavior and closed-loop stimulation based on Open Ephys and Bonsai. J. Neural Eng. 15, 055002 (2018).
pubmed: 29946057
Lim, J. & Celikel, T. Real-time contextual feedback for close-loop control of navigation. J. Neural Eng. 16, https://iopscience.iop.org/article/10.1088/1741-2552/ab2ffa (2019).
Stephens, D. W., Brown, J. S. & Ydenberg, R. C. Foraging: Behavior and Ecology (University of Chicago Press, 2008).
Krebs, J. R. & Davies, N. B. Behavioural Ecology: An Evolutionary Approach (John Wiley & Sons, 2009).
Silcox, M. T. & López-Torres, S. Major questions in the study of primate origins. Ann. Rev. Earth Planet. Sci. 45, 113–137 (2017).
Grobéty, M.-C. & Schenk, F. Spatial learning in a three-dimensional maze. Anim. Behav. 43, 1011–1020 (1992).
Jovalekic, A. et al. Horizontal biases in rats’ use of three-dimensional space. Behav. Brain Res. 222, 279–288 (2011).
pubmed: 21419172
pmcid: 3157560
Skinner, B. F. The Behaviour of Organisms (D. Appleton and Co., 1938).
Breland, K. & Breland, M. A field of applied animal psychology. Am. Psychol. 6, 202–204 (1951).
pubmed: 14847139
Pryor, K. Don’t Shoot the Dog! The New Art of Teaching and Training revised edn (Bantam Books, 1999).
Wiltschko, A. B. et al. Mapping sub-second structure in mouse behavior. Neuron 88, 1121–1135 (2015).
pubmed: 26687221
pmcid: 4708087
Mathis, A. et al. DeepLabCut: markerless pose estimation of user-defined body parts with deep learning. Nat. Neurosci. 21, 1281–1289 (2018).
pubmed: 30127430
Tsai, H.-C. et al. Phasic firing in dopaminergic neurons is sufficient for behavioral conditioning. Science 324, 1080–1084 (2009).
pubmed: 19389999
pmcid: 5262197
O’keefe, J. & Nadel, L. The Hippocampus as a Cognitive Map (Clarendon Press, 1978).
Wilson, M. A. & McNaughton, B. L. Dynamics of the hippocampal ensemble code for space. Science 261, 1055–1058 (1993).
pubmed: 8351520
Ulanovsky, N. Neuroscience: how is three-dimensional space encoded in the brain? Curr. Biol. 21, R886–R888 (2011).
pubmed: 22075427
Finkelstein, A. et al. Three-dimensional head-direction coding in the bat brain. Nature 517, 159–164 (2015).
pubmed: 25470055
Pereira, T. D. et al. Fast animal pose estimation using deep neural networks. Nat. Methods 16, 117–125 (2019).
pubmed: 30573820
Gershenfeld, N., Krikorian, R. & Cohen, D. The internet of things. Sci. Am. 291, 76–81 (2004).
pubmed: 15487673
Perret, M., Gomez, D., Barbosa, A., Aujard, F. & Théry, M. Increased late night response to light controls the circadian pacemaker in a nocturnal primate. J. Biol. Rhythms 25, 186–196 (2010).
pubmed: 20484690
Perret, M. Change in photoperiodic cycle affects life span in a prosimian primate (Microcebus murinus). J. Biol. Rhythms 12, 136–145 (1997).
pubmed: 9090567
Guo, Z. V. et al. Procedures for behavioral experiments in head-fixed mice. PLoS ONE 9, e88678 (2014).
pubmed: 24520413
pmcid: 3919818
Harltey, A. & Zisserman, A. Multiple View Geometry in Computer Vision (Cambridge Univ. Press, 2006).
Hartley, R. I. & Sturm, P. Triangulation. Comput. Vis. Image Underst. 68, 146–157 (1997).
Nistér, D. An efficient solution to the five-point relative pose problem. IEEE Trans. Pattern Anal. Mach. Intell. 26, 756–777 (2004).
pubmed: 18579936
Zach, C. Robust bundle adjustment revisited. In Proc. Computer Vision – ECCV 2014 772–787 (Springer, 2014).
Bons, N. A Stereotaxic Atlas of the Grey Lesser Mouse Lemur Brain (Microcebus murinus) (Elsevier, 1998).
Dhenain, M., Ruffins, S. W. & Jacobs, R. E. Three-dimensional digital mouse atlas using high-resolution MRI. Dev. Biol. 232, 458–470 (2001).
pubmed: 11401405
Nadkarni, N. A., Bougacha, S., Garin, C., Dhenain, M. & Picq, J.-L. Digital templates and brain atlas dataset for the mouse lemur primate. Data Brief 21, 1178–1185 (2018).
pubmed: 30456231
pmcid: 6230976