Reconstruction of natural images from responses of primate retinal ganglion cells.
decoding
macaca fascicularis
natural images
neuroscience
reconstruction
retina
retinal ganglion cells
rhesus macaque
Journal
eLife
ISSN: 2050-084X
Titre abrégé: Elife
Pays: England
ID NLM: 101579614
Informations de publication
Date de publication:
04 11 2020
04 11 2020
Historique:
received:
02
05
2020
accepted:
02
11
2020
pubmed:
5
11
2020
medline:
23
3
2021
entrez:
4
11
2020
Statut:
epublish
Résumé
The visual message conveyed by a retinal ganglion cell (RGC) is often summarized by its spatial receptive field, but in principle also depends on the responses of other RGCs and natural image statistics. This possibility was explored by linear reconstruction of natural images from responses of the four numerically-dominant macaque RGC types. Reconstructions were highly consistent across retinas. The optimal reconstruction filter for each RGC - its visual message - reflected natural image statistics, and resembled the receptive field only when nearby, same-type cells were included. ON and OFF cells conveyed largely independent, complementary representations, and parasol and midget cells conveyed distinct features. Correlated activity and nonlinearities had statistically significant but minor effects on reconstruction. Simulated reconstructions, using linear-nonlinear cascade models of RGC light responses that incorporated measured spatial properties and nonlinearities, produced similar results. Spatiotemporal reconstructions exhibited similar spatial properties, suggesting that the results are relevant for natural vision. Vision begins in the retina, the layer of tissue that lines the back of the eye. Light-sensitive cells called rods and cones absorb incoming light and convert it into electrical signals. They pass these signals to neurons called retinal ganglion cells (RGCs), which convert them into electrical signals called spikes. Spikes from RGCs then travel along the optic nerve to the brain. They are the only source of visual information that the brain receives. From this information, the brain constructs our entire visual world. The primate retina contains roughly 20 types of RGCs. Each encodes a different visual feature, such as the presence of bright spots of a certain size, or information about texture and movement. But exactly what input each RGC sends to the brain, and how the brain uses this information, is unclear. Brackbill et al. set out to answer these questions by measuring and analyzing the electrical activity in isolated retinas from macaque monkeys. Studying the macaque retina was important because the primate visual system differs from that of other species in several ways. These include the numbers and types of RGCs present in the retina. These primates are also similar to humans in their high-resolution central vision and trichromatic color vision. Using electrode arrays to monitor hundreds of RGCs at the same time, Brackbill et al. recorded the responses of macaque retinas to real-life images of landscapes, objects, animals or people. Based on these recordings, plus existing knowledge about RGC responses, Brackbill et al. then attempted to reconstruct the original images using just the electrical activity recorded. The resulting reconstructions were similar across all retinas tested. Moreover, they showed a striking resemblance to the original images. These results made it possible to comprehend how the light-response properties of each cell represent visual information that can be used by the brain. Understanding how macaque retinas work in natural conditions is critical to decoding how our own retinas process and convey information. A better knowledge of how the brain uses this input to generate images could ultimately make it possible to design artificial retinas to restore vision in patients with certain forms of blindness.
Autres résumés
Type: plain-language-summary
(eng)
Vision begins in the retina, the layer of tissue that lines the back of the eye. Light-sensitive cells called rods and cones absorb incoming light and convert it into electrical signals. They pass these signals to neurons called retinal ganglion cells (RGCs), which convert them into electrical signals called spikes. Spikes from RGCs then travel along the optic nerve to the brain. They are the only source of visual information that the brain receives. From this information, the brain constructs our entire visual world. The primate retina contains roughly 20 types of RGCs. Each encodes a different visual feature, such as the presence of bright spots of a certain size, or information about texture and movement. But exactly what input each RGC sends to the brain, and how the brain uses this information, is unclear. Brackbill et al. set out to answer these questions by measuring and analyzing the electrical activity in isolated retinas from macaque monkeys. Studying the macaque retina was important because the primate visual system differs from that of other species in several ways. These include the numbers and types of RGCs present in the retina. These primates are also similar to humans in their high-resolution central vision and trichromatic color vision. Using electrode arrays to monitor hundreds of RGCs at the same time, Brackbill et al. recorded the responses of macaque retinas to real-life images of landscapes, objects, animals or people. Based on these recordings, plus existing knowledge about RGC responses, Brackbill et al. then attempted to reconstruct the original images using just the electrical activity recorded. The resulting reconstructions were similar across all retinas tested. Moreover, they showed a striking resemblance to the original images. These results made it possible to comprehend how the light-response properties of each cell represent visual information that can be used by the brain. Understanding how macaque retinas work in natural conditions is critical to decoding how our own retinas process and convey information. A better knowledge of how the brain uses this input to generate images could ultimately make it possible to design artificial retinas to restore vision in patients with certain forms of blindness.
Identifiants
pubmed: 33146609
doi: 10.7554/eLife.58516
pii: 58516
pmc: PMC7752138
doi:
pii:
Types de publication
Journal Article
Research Support, N.I.H., Extramural
Research Support, Non-U.S. Gov't
Research Support, U.S. Gov't, Non-P.H.S.
Langues
eng
Sous-ensembles de citation
IM
Subventions
Organisme : NEI NIH HHS
ID : R01 EY017992
Pays : United States
Organisme : NEI NIH HHS
ID : R01 EY029247
Pays : United States
Organisme : NIH HHS
ID : IIS-1430348
Pays : United States
Organisme : NEI NIH HHS
ID : F31 EY027166
Pays : United States
Organisme : National Science Foundation
ID : IIS-1430348
Pays : International
Organisme : National Science Foundation
ID : GRFP DGE-114747
Pays : International
Organisme : NEI NIH HHS
ID : F31EY027166
Pays : United States
Organisme : National Science Foundation
ID : IGERT 0801700
Pays : International
Informations de copyright
© 2020, Brackbill et al.
Déclaration de conflit d'intérêts
NB, CR, AK, NS, AS, AL, EC No competing interests declared
Références
Nature. 2010 Oct 7;467(7316):673-7
pubmed: 20930838
J Neurosci. 2009 Apr 8;29(14):4675-80
pubmed: 19357292
Curr Biol. 2012 Mar 20;22(6):510-4
pubmed: 22342751
Elife. 2015 Oct 30;4:
pubmed: 26517879
Nat Neurosci. 2009 Sep;12(9):1159-64
pubmed: 19668201
Phys Rev Lett. 1994 Aug 8;73(6):814-817
pubmed: 10057546
Nat Neurosci. 2011 May 29;14(7):919-25
pubmed: 21623365
Neuron. 2012 Feb 9;73(3):415-34
pubmed: 22325196
Nature. 2010 Dec 16;468(7326):964-7
pubmed: 21131948
J Neurophysiol. 1997 Nov;78(5):2336-50
pubmed: 9356386
Science. 1991 Jun 28;252(5014):1854-7
pubmed: 2063199
J Neural Eng. 2019 Apr;16(2):025003
pubmed: 30523985
Rep Prog Phys. 2016 Sep;79(9):096701
pubmed: 27502748
Neuron. 2012 Oct 18;76(2):266-80
pubmed: 23083731
J Neurosci Methods. 2010 Jun 15;189(2):267-80
pubmed: 20359500
Vis Neurosci. 1997 Jan-Feb;14(1):169-85
pubmed: 9057278
PLoS Comput Biol. 2019 Nov 14;15(11):e1007476
pubmed: 31725714
Neuron. 2016 Jun 15;90(6):1257-1271
pubmed: 27263968
Neuron. 2018 Mar 21;97(6):1327-1340.e4
pubmed: 29503188
J Physiol. 1975 Sep;251(1):167-95
pubmed: 810576
J Physiol. 1983 Aug;341:279-307
pubmed: 6620181
Neuroimage. 2011 May 15;56(2):400-10
pubmed: 20691790
J Neurophysiol. 2005 Jul;94(1):119-35
pubmed: 15625091
PLoS One. 2007 Feb 28;2(2):e251
pubmed: 17330140
J Neurosci. 1993 Dec;13(12):5334-55
pubmed: 8254378
Nat Neurosci. 2010 Feb;13(2):156-7
pubmed: 20023654
Neuron. 2003 Jan 9;37(1):15-27
pubmed: 12526769
eNeuro. 2016 Jun 03;3(3):
pubmed: 27275008
J Neurophysiol. 2004 Aug;92(2):780-9
pubmed: 15277596
J Physiol. 1968 Dec;199(3):533-47
pubmed: 4974745
Vision Res. 1985;25(12):1795-810
pubmed: 3832605
J Neurosci. 2006 Aug 9;26(32):8254-66
pubmed: 16899720
Nature. 2008 Aug 21;454(7207):995-9
pubmed: 18650810
Neuron. 2019 Aug 21;103(4):658-672.e6
pubmed: 31227309
Nat Commun. 2020 Sep 14;11(1):4605
pubmed: 32929073
J Neurophysiol. 1983 Feb;49(2):350-65
pubmed: 6300342
Spat Vis. 2009;22(2):161-77
pubmed: 19228456
J Physiol. 1982 Dec;333:343-66
pubmed: 7182469
Proc Natl Acad Sci U S A. 1997 May 13;94(10):5411-6
pubmed: 9144251
Science. 2008 Feb 22;319(5866):1108-11
pubmed: 18292344
Neuron. 2009 Sep 24;63(6):902-15
pubmed: 19778517
Neuron. 2016 Jan 20;89(2):369-383
pubmed: 26796691
J Physiol. 2011 Jan 1;589(Pt 1):75-86
pubmed: 20921200
J Neurosci. 2015 Apr 1;35(13):5397-408
pubmed: 25834063
Prog Brain Res. 1983;58:183-90
pubmed: 6195688
J Neurophysiol. 1978 Nov;41(6):1394-1417
pubmed: 104012
Vision Res. 2012 Oct 1;70:44-53
pubmed: 22885035
J Neurosci. 1999 Sep 15;19(18):8036-42
pubmed: 10479703
J Neurophysiol. 1999 Feb;81(2):908-20
pubmed: 10036288
IEEE Trans Image Process. 2004 Apr;13(4):600-12
pubmed: 15376593
Vis Neurosci. 1997 Jan-Feb;14(1):187-205
pubmed: 9057279
J Neurophysiol. 1997 Oct;78(4):2048-60
pubmed: 9325372
Vision Res. 1990;30(7):985-91
pubmed: 2392842
J Opt Soc Am A. 1987 Aug;4(8):1524-9
pubmed: 3625332
Vis Neurosci. 1994 Jan-Feb;11(1):111-8
pubmed: 8011574
Science. 1995 Nov 17;270(5239):1207-10
pubmed: 7502047
J Neurophysiol. 1953 Jan;16(1):37-68
pubmed: 13035466
PLoS One. 2013;8(1):e53063
pubmed: 23301021
Elife. 2015 Sep 08;4:
pubmed: 26347983
Network. 2001 May;12(2):199-213
pubmed: 11405422
Neural Netw. 2020 May;125:19-30
pubmed: 32070853
PLoS Comput Biol. 2018 May 10;14(5):e1006057
pubmed: 29746463
J Neurosci. 2002 Apr 1;22(7):2737-47
pubmed: 11923439
Neuron. 2005 May 5;46(3):493-504
pubmed: 15882648
J Neurosci. 2010 Jul 21;30(29):9659-69
pubmed: 20660249
Vision Res. 1984;24(6):549-64
pubmed: 6740975
Nature. 2001 Jun 7;411(6838):698-701
pubmed: 11395773
J Neurosci. 2007 Nov 28;27(48):13261-72
pubmed: 18045920
Nat Neurosci. 2011 Jun 05;14(7):926-32
pubmed: 21642976
Proc Natl Acad Sci U S A. 1992 Oct 15;89(20):9666-70
pubmed: 1409680