Crossmodal sensory neurons based on high-performance flexible memristors for human-machine in-sensor computing system.
Journal
Nature communications
ISSN: 2041-1723
Titre abrégé: Nat Commun
Pays: England
ID NLM: 101528555
Informations de publication
Date de publication:
23 Aug 2024
23 Aug 2024
Historique:
received:
05
03
2024
accepted:
13
08
2024
medline:
24
8
2024
pubmed:
24
8
2024
entrez:
23
8
2024
Statut:
epublish
Résumé
Constructing crossmodal in-sensor processing system based on high-performance flexible devices is of great significance for the development of wearable human-machine interfaces. A bio-inspired crossmodal in-sensor computing system can perform real-time energy-efficient processing of multimodal signals, alleviating data conversion and transmission between different modules in conventional chips. Here, we report a bio-inspired crossmodal spiking sensory neuron (CSSN) based on a flexible VO
Identifiants
pubmed: 39179548
doi: 10.1038/s41467-024-51609-x
pii: 10.1038/s41467-024-51609-x
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
7275Subventions
Organisme : National Natural Science Foundation of China (National Science Foundation of China)
ID : Grant No. 62175248
Informations de copyright
© 2024. The Author(s).
Références
Li, G., Liu, S., Wang, L. & Zhu, R. Skin-inspired quadruple tactile sensors integrated on a robot hand enable object recognition. Sci. Robot. 5, eabc8134 (2020).
pubmed: 33328298
doi: 10.1126/scirobotics.abc8134
Chortos, A., Liu, J. & Bao, Z. Pursuing prosthetic electronic skin. Nat. Mater. 15, 937–950 (2016).
pubmed: 27376685
doi: 10.1038/nmat4671
Mittendorfer, P. & Cheng, G. Humanoid multimodal tactile-sensing modules. IEEE Trans. Robot. 27, 401–410 (2011).
doi: 10.1109/TRO.2011.2106330
Liu, M. et al. A star-nose-like tactile-olfactory bionic sensing array for robust object recognition in non-visual environments. Nat. Commun. 13, 79 (2022).
pubmed: 35013205
pmcid: 8748716
doi: 10.1038/s41467-021-27672-z
Wang, M. et al. Gesture recognition using a bioinspired learning architecture that integrates visual data with somatosensory data from stretchable sensors. Nat. Electron. 3, 563–570 (2020).
doi: 10.1038/s41928-020-0422-z
Pei, J. et al. Towards artificial general intelligence with hybrid Tianjic chip architecture. Nature 572, 106–111 (2019).
pubmed: 31367028
doi: 10.1038/s41586-019-1424-8
Yu, F. et al. Brain-inspired multimodal hybrid neural network for robot place recognition. Sci. Robot. 8, eabm6996 (2023).
pubmed: 37163608
doi: 10.1126/scirobotics.abm6996
Ma, S. et al. Neuromorphic computing chip with spatiotemporal elasticity for multi-intelligent-tasking robots. Sci. Robot. 7, eabk2948 (2022).
pubmed: 35704609
doi: 10.1126/scirobotics.abk2948
Güler, P. Bekiroglu, Y. Gratal, X. Pauwels, K. & Kragic, D. What’s in the container? classifying object contents from vision and touch. In 2014 IEEE/RSJ Int. Conf. Intell. Robots Syst. 3961–3968 (IEEE, 2014).
Toprak, S., Navarro-Guerrero, N. & Wermter, S. Evaluating integration strategies for visuo-haptic object recognition. Cogn. Comput. 10, 408–425 (2018).
doi: 10.1007/s12559-017-9536-7
Proske, U. & Gandevia, S. The proprioceptive senses: their roles in signaling body shape, body position and movement, and muscle force. Physiol. Rev. 92, 1651–1697 (2012).
pubmed: 23073629
doi: 10.1152/physrev.00048.2011
Collins, D., Refshauge, K. & Gandevia, S. Sensory integration in the perception of movements at the human metacarpophalangeal joint. J. Physiol. 529, 505–515 (2000).
pubmed: 11101658
pmcid: 2270207
doi: 10.1111/j.1469-7793.2000.00505.x
Fetsch, C., DeAngelis, G. & Angelaki, D. Bridging the gap between theories of sensory cue integration and the physiology of multisensory neurons. Nat. Rev. Neurosci. 14, 429–442 (2013).
pubmed: 23686172
doi: 10.1038/nrn3503
Zhou, F. & Chai, Y. Near-sensor and in-sensor computing. Nat. Electron. 3, 664–671 (2020).
doi: 10.1038/s41928-020-00501-9
Chua, L. Memristor-The missing circuit element. IEEE Trans. Circuit Theory 18, 507–519 (1971).
doi: 10.1109/TCT.1971.1083337
Strukov, D., Snider, G., Stewart, D. & Williams, R. The missing memristor found. Nature 453, 80–83 (2008).
pubmed: 18451858
doi: 10.1038/nature06932
Boybat, I. et al. Neuromorphic computing with multi-memristive synapses. Nat. Commun. 9, 2514 (2018).
pubmed: 29955057
pmcid: 6023896
doi: 10.1038/s41467-018-04933-y
Tan, Z. et al. Synaptic metaplasticity realized in oxide memristive devices. Adv. Mater. 28, 377–384 (2016).
pubmed: 26573772
doi: 10.1002/adma.201503575
Yao, P. et al. Face classification using electronic synapses. Nat. Commun. 8, 15199 (2017).
pubmed: 28497781
pmcid: 5437298
doi: 10.1038/ncomms15199
Kumar, S., Williams, R. & Wang, Z. Third-order nanocircuit elements for neuromorphic engineering. Nature 585, 518–523 (2020).
pubmed: 32968256
doi: 10.1038/s41586-020-2735-5
Fu, Y. et al. Forming-free and annealing-free V/VO
Yi, W. et al. Biological plausibility and stochasticity in scalable VO
pubmed: 30405124
pmcid: 6220189
doi: 10.1038/s41467-018-07052-w
Yuan, R. et al. A calibratable sensory neuron based on epitaxial VO
pubmed: 35803938
pmcid: 9270461
doi: 10.1038/s41467-022-31747-w
Cho, H. et al. Real-time finger motion recognition using skin-conformable electronics. Nat. Electron. 6, 619–629 (2023).
doi: 10.1038/s41928-023-01012-z
Wang, Y. et al. Memristor-based biomimetic compound eye for real-time collision detection. Nat. Commun. 12, 5979 (2021).
pubmed: 34645801
pmcid: 8514515
doi: 10.1038/s41467-021-26314-8
Zhang, X. et al. An artificial spiking afferent nerve based on Mott memristors for neurorobotics. Nat. Commun. 11, 51 (2020).
pubmed: 31896758
pmcid: 6940364
doi: 10.1038/s41467-019-13827-6
Lee, J. et al. An artificial tactile neuron enabling spiking representation of stiffness and disease diagnosis. Adv. Mater. 34, 2201608 (2022).
doi: 10.1002/adma.202201608
Tan, H. et al. Tactile sensory coding and learning with bioinspired optoelectronic spiking afferent nerves. Nat. Commun. 11, 1369 (2020).
pubmed: 32170075
pmcid: 7070032
doi: 10.1038/s41467-020-15105-2
Duan, Q. et al. Artificial multisensory neurons with fused haptic and temperature perception for multimodal in‐sensor computing. Adv. Intell. Syst. 4, 2200039 (2022).
doi: 10.1002/aisy.202200039
Gao, B. et al. Memristor-based analogue computing for brain-inspired sound localization with in situ training. Nat. Commun. 13, 2026 (2022).
pubmed: 35440127
pmcid: 9018844
doi: 10.1038/s41467-022-29712-8
Wang, C. et al. Parallel in-memory wireless computing. Nat. Electron. 6, 381–389 (2023).
doi: 10.1038/s41928-023-00965-5
Li, G. et al. Photo-induced non-volatile VO
pubmed: 35365642
pmcid: 8975822
doi: 10.1038/s41467-022-29456-5
Deng, S. et al. Selective area doping for Mott neuromorphic electronics. Sci. Adv. 9, eade4838 (2023).
Stinson, H. T. et al. Imaging the nanoscale phase separation in vanadium dioxide thin films at terahertz frequencies. Nat. Commun. 9, 3604 (2018).
pubmed: 30190517
pmcid: 6127259
doi: 10.1038/s41467-018-05998-5
Luo, Y. et al. Technology roadmap for flexible sensors. ACS Nano 17, 5211–5295 (2023).
pubmed: 36892156
pmcid: 11223676
doi: 10.1021/acsnano.2c12606
Liu, F. et al. Printed synaptic transistor–based electronic skin for robots to feel and learn. Sci. Robot. 7, eabl7286 (2022).
pubmed: 35648845
doi: 10.1126/scirobotics.abl7286
Xu, Y. et al. Electrohydrodynamically printed flexible organic memristor for leaky integrate and fire neuron. IEEE Electron Device Lett. 43, 116–119 (2022).
doi: 10.1109/LED.2021.3129202
Han, C. et al. Characterization and modelling of flexible VO
doi: 10.1002/admi.202200394
Tang, L. et al. Halide perovskite memristor with ultra-high-speed and robust flexibility for artificial neuron applications. J. Mater. Chem. C. 10, 14695–14702 (2022).
doi: 10.1039/D2TC03355K
Zhu, J. et al. A flexible LIF neuron based on NbO
Fu, T. et al. Self-sustained green neuromorphic interfaces. Nat. Commun. 12, 3351 (2021).
pubmed: 34099691
pmcid: 8184933
doi: 10.1038/s41467-021-23744-2
Fu, T. et al. Bioinspired bio-voltage memristors. Nat. Commun. 11, 1861 (2020).
pubmed: 32313096
pmcid: 7171104
doi: 10.1038/s41467-020-15759-y
Yan, L. et al. High-speed Si films based threshold switching device and its artificial neuron application. Appl. Phys. Lett. 119, 153507 (2021).
doi: 10.1063/5.0063078
Park, S.-O., Jeong, H., Park, J., Bae, J. & Choi, S. Experimental demonstration of highly reliable dynamic memristor for artificial neuron and neuromorphic computing. Nat. Commun. 13, 2888 (2022).
pubmed: 35660724
pmcid: 9166790
doi: 10.1038/s41467-022-30539-6
Jia, S. et al. Ultrahigh drive current and large selectivity in GeS selector. Nat. Commun. 11, 4636 (2020).
pubmed: 32934210
pmcid: 7493911
doi: 10.1038/s41467-020-18382-z
Duan, Q. et al. Spiking neurons with spatiotemporal dynamics and gain modulation for monolithically integrated memristive neural networks. Nat. Commun. 11, 3399 (2020).
pubmed: 32636385
pmcid: 7341810
doi: 10.1038/s41467-020-17215-3
Lee, S. B., Kim, K., Oh, J. S., Kahng, B. & Lee, J. S. Origin of variation in switching voltages in threshold-switching phenomena of VO
doi: 10.1063/1.4790842
Wang, P., Khan, A. & Yu, S. Cryogenic behavior of NbO
doi: 10.1063/5.0006467
Liu, K. et al. An optoelectronic synapse based on α-In
doi: 10.1038/s41928-022-00847-2
Yu, X. et al. Skin-integrated wireless haptic interfaces for virtual and augmented reality. Nature 575, 473–479 (2019).
pubmed: 31748722
doi: 10.1038/s41586-019-1687-0
Chun, S. et al. An artificial neural tactile sensing system. Nat. Electron. 4, 429–438 (2021).
doi: 10.1038/s41928-021-00585-x
Lee, W.-W. et al. A neuro-inspired artificial peripheral nervous system for scalable electronic skins. Sci. Robot. 4, eaax2198 (2019).
pubmed: 33137772
doi: 10.1126/scirobotics.aax2198
Wan, C. et al. An artificial sensory neuron with visual-haptic fusion. Nat. Commun. 11, 4602 (2020).
pubmed: 32929071
pmcid: 7490423
doi: 10.1038/s41467-020-18375-y
Wang, W. et al. Neuromorphic sensorimotor loop embodied by monolithically integrated, low-voltage, soft e-skin. Science 380, 735–742 (2023).
pubmed: 37200416
doi: 10.1126/science.ade0086
Gauthier, D., Bollt, E., Griffith, A. & Barbosa, W. Next generation reservoir computing. Nat. Commun. 12, 5564 (2021).
pubmed: 34548491
pmcid: 8455577
doi: 10.1038/s41467-021-25801-2
Appeltant, L. et al. Information processing using a single dynamical node as complex system. Nat. Commun. 2, 468 (2011).
pubmed: 21915110
doi: 10.1038/ncomms1476
Nath, S. K. et al. Optically tunable electrical oscillations in oxide‐based memristors for neuromorphic computing. Adv. Mater. 36, 2400904 (2024).
doi: 10.1002/adma.202400904
Shi, K. et al. An oxide based spiking thermoreceptor for low-power thermography edge detection. IEEE Electron Device Lett. 43, 2196–2199 (2022).
doi: 10.1109/LED.2022.3215693
Sarkar, T. et al. An organic artificial spiking neuron for in situ neuromorphic sensing and biointerfacing. Nat. Electron. 5, 774–783 (2022).
doi: 10.1038/s41928-022-00859-y
Wang, X. et al. Vertically integrated spiking cone photoreceptor arrays for color perception. Nat. Commun. 14, 3444 (2023).
pubmed: 37301894
pmcid: 10257685
doi: 10.1038/s41467-023-39143-8
Sadaf, M. U. K., Sakib, N. U., Pannone, A., Ravichandran, H. & Das, S. A bio-inspired visuotactile neuron for multisensory integration. Nat. Commun. 14, 5729 (2023).
pubmed: 37714853
pmcid: 10504285
doi: 10.1038/s41467-023-40686-z
Wang, R. et al. 1-phototransistor-1-threshold switching optoelectronic neuron for in-sensor compression via spiking neuron network. In 2023 International Electron Devices Meeting (IEDM) 1–4 (IEEE, 2023).