Interpreting wide-band neural activity using convolutional neural networks.


Journal

eLife
ISSN: 2050-084X
Titre abrégé: Elife
Pays: England
ID NLM: 101579614

Informations de publication

Date de publication:
02 08 2021
Historique:
received: 15 01 2021
accepted: 13 07 2021
entrez: 2 8 2021
pubmed: 3 8 2021
medline: 13 10 2021
Statut: epublish

Résumé

Rapid progress in technologies such as calcium imaging and electrophysiology has seen a dramatic increase in the size and extent of neural recordings. Even so, interpretation of this data requires considerable knowledge about the nature of the representation and often depends on manual operations. Decoding provides a means to infer the information content of such recordings but typically requires highly processed data and prior knowledge of the encoding scheme. Here, we developed a deep-learning framework able to decode sensory and behavioral variables directly from wide-band neural data. The network requires little user input and generalizes across stimuli, behaviors, brain regions, and recording techniques. Once trained, it can be analyzed to determine elements of the neural code that are informative about a given variable. We validated this approach using electrophysiological and calcium-imaging data from rodent auditory cortex and hippocampus as well as human electrocorticography (ECoG) data. We show successful decoding of finger movement, auditory stimuli, and spatial behaviors - including a novel representation of head direction - from raw neural activity.

Identifiants

pubmed: 34338632
doi: 10.7554/eLife.66551
pii: 66551
pmc: PMC8328518
doi:
pii:

Banques de données

figshare
['10.6084/m9.figshare.c.5486703.v1']

Types de publication

Journal Article Research Support, Non-U.S. Gov't

Langues

eng

Sous-ensembles de citation

IM

Subventions

Organisme : Wellcome Trust
Pays : United Kingdom
Organisme : Wellcome Trust
ID : 110238/Z/15/Z
Pays : United Kingdom
Organisme : Wellcome Trust
ID : 212281/Z/18/Z
Pays : United Kingdom

Informations de copyright

© 2021, Frey et al.

Déclaration de conflit d'intérêts

MF, ST, CP, AO, MN, JK, AB, DB, JL, CD, CB No competing interests declared

Références

PLoS Comput Biol. 2019 Feb 15;15(2):e1006822
pubmed: 30768590
Front Syst Neurosci. 2013 May 13;7:8
pubmed: 23717267
Nature. 2005 Aug 11;436(7052):801-6
pubmed: 15965463
Nature. 2013 Jul 18;499(7458):295-300
pubmed: 23868258
J Neurosci. 1987 Jul;7(7):1935-50
pubmed: 3612225
Nature. 2003 Feb 20;421(6925):844-8
pubmed: 12594513
Cell Rep. 2018 Nov 13;25(7):1872-1884.e4
pubmed: 30428354
Neuron. 2014 Oct 22;84(2):442-56
pubmed: 25374363
J Neurosci. 2011 Oct 12;31(41):14565-76
pubmed: 21994373
J Neurophysiol. 2000 Jul;84(1):401-14
pubmed: 10899214
J Neurophysiol. 1998 Feb;79(2):1017-44
pubmed: 9463459
Science. 2014 May 9;344(6184):626-30
pubmed: 24812401
Nat Commun. 2019 May 27;10(1):2333
pubmed: 31133685
Elife. 2015 Jun 26;4:e06063
pubmed: 26112828
J Comp Physiol Psychol. 1975 Jan;88(1):324-8
pubmed: 1120805
Nature. 2010 Feb 4;463(7281):657-61
pubmed: 20090680
Nature. 2015 May 28;521(7553):436-44
pubmed: 26017442
J Neurosci. 2014 Jan 15;34(3):1067-80
pubmed: 24431464
J Neurosci. 2006 Jan 11;26(2):622-31
pubmed: 16407560
PLoS One. 2013 Apr 17;8(4):e61976
pubmed: 23613992
Neuron. 2017 Sep 13;95(6):1381-1394.e6
pubmed: 28910621
J Neurophysiol. 2014 Jan;111(1):217-27
pubmed: 24089403
Science. 2006 May 5;312(5774):758-62
pubmed: 16675704
J Neurosci. 1994 Dec;14(12):7235-51
pubmed: 7996172
J Neurosci. 1999 Jan 1;19(1):274-87
pubmed: 9870957
J Neural Eng. 2015 Jun;12(3):036009
pubmed: 25946198
Neuron. 2020 Feb 5;105(3):416-434
pubmed: 32027833
Brain Res. 1971 Nov;34(1):171-5
pubmed: 5124915
J Neural Eng. 2007 Sep;4(3):264-75
pubmed: 17873429
J Neural Eng. 2017 Aug;14(4):045003
pubmed: 28169219
IEEE Trans Biomed Eng. 2004 Jun;51(6):912-8
pubmed: 15188858
Nature. 2015 Jul 23;523(7561):419-24
pubmed: 26176924
Hippocampus. 1993 Jul;3(3):317-30
pubmed: 8353611
Exp Neurol. 1975 Oct;49(1 Pt 1):58-85
pubmed: 1183532
IEEE Trans Neural Syst Rehabil Eng. 2009 Oct;17(5):487-96
pubmed: 19666343
Neuron. 2011 Apr 14;70(1):109-20
pubmed: 21482360
J Neurophysiol. 2007 Jun;97(6):4152-61
pubmed: 17392415
Elife. 2016 Jun 10;5:
pubmed: 27282390
J Physiol. 1959 Oct;148:574-91
pubmed: 14403679
Neuron. 2017 Oct 11;96(2):505-520.e7
pubmed: 29024669
J Neurosci. 2016 Jun 22;36(25):6605-22
pubmed: 27335395
Hippocampus. 2008;18(12):1175-85
pubmed: 19021251
Neural Comput. 2015 Jul;27(7):1438-60
pubmed: 25973549
J Exp Anal Behav. 2005 Nov;84(3):581-617
pubmed: 16596981
Trends Cogn Sci. 2019 Apr;23(4):305-317
pubmed: 30795896
Neuron. 2017 Apr 19;94(2):375-387.e7
pubmed: 28392071
Physiol Behav. 1987;39(4):513-9
pubmed: 3575499
Nature. 2015 Feb 26;518(7540):529-33
pubmed: 25719670

Auteurs

Markus Frey (M)

Kavli Institute for Systems Neuroscience, Centre for Neural Computation, The Egil and Pauline Braathen and Fred Kavli Centre for Cortical Microcircuits, NTNU, Norwegian University of Science and Technology, Trondheim, Norway.
Max-Planck-Insitute for Human Cognitive and Brain Sciences, Leipzig, Germany.

Sander Tanni (S)

Cell & Developmental Biology, UCL, London, United Kingdom.

Catherine Perrodin (C)

Institute of Behavioural Neuroscience, UCL, London, United Kingdom.

Alice O'Leary (A)

Cell & Developmental Biology, UCL, London, United Kingdom.

Matthias Nau (M)

Kavli Institute for Systems Neuroscience, Centre for Neural Computation, The Egil and Pauline Braathen and Fred Kavli Centre for Cortical Microcircuits, NTNU, Norwegian University of Science and Technology, Trondheim, Norway.
Max-Planck-Insitute for Human Cognitive and Brain Sciences, Leipzig, Germany.

Jack Kelly (J)

Open Climate Fix, London, United Kingdom.

Andrea Banino (A)

DeepMind, London, United Kingdom.

Daniel Bendor (D)

Institute of Behavioural Neuroscience, UCL, London, United Kingdom.

Julie Lefort (J)

Cell & Developmental Biology, UCL, London, United Kingdom.

Christian F Doeller (CF)

Kavli Institute for Systems Neuroscience, Centre for Neural Computation, The Egil and Pauline Braathen and Fred Kavli Centre for Cortical Microcircuits, NTNU, Norwegian University of Science and Technology, Trondheim, Norway.
Max-Planck-Insitute for Human Cognitive and Brain Sciences, Leipzig, Germany.
Institute of Psychology, Leipzig University, Leipzig, Germany.

Caswell Barry (C)

Cell & Developmental Biology, UCL, London, United Kingdom.

Articles similaires

[Redispensing of expensive oral anticancer medicines: a practical application].

Lisanne N van Merendonk, Kübra Akgöl, Bastiaan Nuijen
1.00
Humans Antineoplastic Agents Administration, Oral Drug Costs Counterfeit Drugs

Smoking Cessation and Incident Cardiovascular Disease.

Jun Hwan Cho, Seung Yong Shin, Hoseob Kim et al.
1.00
Humans Male Smoking Cessation Cardiovascular Diseases Female
Humans United States Aged Cross-Sectional Studies Medicare Part C
1.00
Humans Yoga Low Back Pain Female Male

Classifications MeSH