Measuring instability in chronic human intracortical neural recordings towards stable, long-term brain-computer interfaces.
Journal
Communications biology
ISSN: 2399-3642
Titre abrégé: Commun Biol
Pays: England
ID NLM: 101719179
Informations de publication
Date de publication:
21 Oct 2024
21 Oct 2024
Historique:
received:
08
02
2024
accepted:
26
08
2024
medline:
22
10
2024
pubmed:
22
10
2024
entrez:
21
10
2024
Statut:
epublish
Résumé
Intracortical brain-computer interfaces (iBCIs) enable people with tetraplegia to gain intuitive cursor control from movement intentions. To translate to practical use, iBCIs should provide reliable performance for extended periods of time. However, performance begins to degrade as the relationship between kinematic intention and recorded neural activity shifts compared to when the decoder was initially trained. In addition to developing decoders to better handle long-term instability, identifying when to recalibrate will also optimize performance. We propose a method, "MINDFUL", to measure instabilities in neural data for useful long-term iBCI, without needing labels of user intentions. Longitudinal data were analyzed from two BrainGate2 participants with tetraplegia as they used fixed decoders to control a computer cursor spanning 142 days and 28 days, respectively. We demonstrate a measure of instability that correlates with changes in closed-loop cursor performance solely based on the recorded neural activity (Pearson r = 0.93 and 0.72, respectively). This result suggests a strategy to infer online iBCI performance from neural data alone and to determine when recalibration should take place for practical long-term use.
Identifiants
pubmed: 39433844
doi: 10.1038/s42003-024-06784-4
pii: 10.1038/s42003-024-06784-4
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
1363Subventions
Organisme : U.S. Department of Veterans Affairs (Department of Veterans Affairs)
ID : N2864C, A2295R, A2827R, A3803R
Organisme : U.S. Department of Health & Human Services | NIH | National Institute of Mental Health (NIMH)
ID : T32MH115895
Organisme : U.S. Department of Health & Human Services | NIH | National Institute of Neurological Disorders and Stroke (NINDS)
ID : UH2NS095548, U01NS098968
Organisme : U.S. Department of Health & Human Services | NIH | National Institute on Deafness and Other Communication Disorders (NIDCD)
ID : U01DC017844, R01DC014034
Informations de copyright
© 2024. This is a U.S. Government work and not under copyright protection in the US; foreign copyright protection may apply.
Références
Serruya, M. D., Hatsopoulos, N. G., Paninski, L., Fellows, M. R. & Donoghue, J. P. Instant neural control of a movement signal. Nature 416, 141–142 (2002).
pubmed: 11894084
doi: 10.1038/416141a
Hochberg, L. R. et al. Neuronal ensemble control of prosthetic devices by a human with tetraplegia. Nature 442, 164–171 (2006).
pubmed: 16838014
doi: 10.1038/nature04970
Hochberg, L. R. et al. Reach and grasp by people with tetraplegia using a neurally controlled robotic arm. Nature 485, 372–375 (2012).
pubmed: 22596161
pmcid: 3640850
doi: 10.1038/nature11076
Schwartz, A. B., Cui, X. T., Weber, D. J. & Moran, D. W. Brain-controlled interfaces: movement restoration with neural prosthetics. Neuron 52, 205–220 (2006).
pubmed: 17015237
doi: 10.1016/j.neuron.2006.09.019
Simeral, J. D., Kim, S.-P., Black, M. J., Donoghue, J. P. & Hochberg, L. R. Neural control of cursor trajectory and click by a human with tetraplegia 1000 days after implant of an intracortical microelectrode array. J. Neural Eng. 8, 025027 (2011).
pubmed: 21436513
pmcid: 3715131
doi: 10.1088/1741-2560/8/2/025027
Collinger, J. L. et al. High-performance neuroprosthetic control by an individual with tetraplegia. Lancet 381, 557–564 (2013).
pubmed: 23253623
pmcid: 3641862
doi: 10.1016/S0140-6736(12)61816-9
Gilja, V. et al. Clinical translation of a high-performance neural prosthesis. Nat. Med. 21, 1142–1145 (2015).
pubmed: 26413781
pmcid: 4805425
doi: 10.1038/nm.3953
Kim, S.-P. et al. Point-and-click cursor control with an intracortical neural interface system by humans with tetraplegia. IEEE Trans. Neural Syst. Rehabil. Eng. 19, 193–203 (2011).
pubmed: 21278024
pmcid: 3294291
doi: 10.1109/TNSRE.2011.2107750
Bacher, D. et al. Neural point-and-click communication by a person with incomplete locked-in syndrome. Neurorehabil. Neural Repair 29, 462–471 (2015).
pubmed: 25385765
doi: 10.1177/1545968314554624
Brandman, D. M. et al. Rapid calibration of an intracortical brain-computer interface for people with tetraplegia. J. Neural Eng. 15, 026007 (2018).
pubmed: 29363625
pmcid: 5823702
doi: 10.1088/1741-2552/aa9ee7
Pandarinath, C. et al. High performance communication by people with paralysis using an intracortical brain-computer interface. Elife 6, e18554 (2017).
pubmed: 28220753
pmcid: 5319839
doi: 10.7554/eLife.18554
Jarosiewicz, B. et al. Virtual typing by people with tetraplegia using a self-calibrating intracortical brain-computer interface. Sci. Transl. Med. 7, 313ra179 (2015).
pubmed: 26560357
pmcid: 4765319
doi: 10.1126/scitranslmed.aac7328
Nuyujukian, P. et al. Cortical control of a tablet computer by people with paralysis. PLoS ONE 13, e0204566 (2018).
pubmed: 30462658
pmcid: 6248919
doi: 10.1371/journal.pone.0204566
Willett, F. R. et al. A high-performance speech neuroprosthesis. Nature 620, 1031–1036 (2023).
pubmed: 37612500
pmcid: 10468393
doi: 10.1038/s41586-023-06377-x
Taylor, D. M., Tillery, S. I. H. & Schwartz, A. B. Direct cortical control of 3D neuroprosthetic devices. Science 296, 1829–1832 (2002).
pubmed: 12052948
doi: 10.1126/science.1070291
Andersen, R. A., Snyder, L. H., Bradley, D. C. & Xing, J. Multimodal representation of space in the posterior parietal cortex and its use in planning movements. Annu. Rev. Neurosci. 20, 303–330 (1997).
pubmed: 9056716
doi: 10.1146/annurev.neuro.20.1.303
Homer, M. L., Nurmikko, A. V., Donoghue, J. P. & Hochberg, L. R. Sensors and decoding for intracortical brain computer interfaces. Annu. Rev. Biomed. Eng. 15, 383–405 (2013).
pubmed: 23862678
pmcid: 3985135
doi: 10.1146/annurev-bioeng-071910-124640
Downey, J. E., Schwed, N., Chase, S. M., Schwartz, A. B. & Collinger, J. L. Intracortical recording stability in human brain–computer interface users. J. neural Eng. 15, 046016 (2018).
pubmed: 29553484
doi: 10.1088/1741-2552/aab7a0
Perge, J. A. et al. Intra-day signal instabilities affect decoding performance in an intracortical neural interface system. J. Neural Eng. 10, 036004 (2013).
pubmed: 23574741
pmcid: 3693851
doi: 10.1088/1741-2560/10/3/036004
Sussillo, D., Stavisky, S. D., Kao, J. C., Ryu, S. I. & Shenoy, K. V. Making brain-machine interfaces robust to future neural variability. Nat. Commun. 7, 13749 (2016).
pubmed: 27958268
pmcid: 5159828
doi: 10.1038/ncomms13749
Degenhart, A. D. et al. Stabilization of a brain–computer interface via the alignment of low-dimensional spaces of neural activity. Nat. Biomed. Eng. 4, 672–685 (2020).
pubmed: 32313100
pmcid: 7822646
doi: 10.1038/s41551-020-0542-9
Nuyujukian, P. et al. Performance sustaining intracortical neural prostheses. J. Neural Eng. 11, 066003 (2014).
pubmed: 25307561
doi: 10.1088/1741-2560/11/6/066003
Davis, S. E. et al. A nonparametric updating method to correct clinical prediction model drift. J. Am. Med. Inform. Assoc. 26, 1448–1457 (2019).
pubmed: 31397478
pmcid: 6857513
doi: 10.1093/jamia/ocz127
Tsymbal, A. The Problem of Concept Drift: Definitions and Related Work. (Tech. Rep. Department of Computer Science, Trinity College, 2004).
Gama, J., Medas, P., Castillo, G. & Rodrigues, P. in Advances in Artificial Intelligence—SBIA 2004. 286–295 (Springer Berlin Heidelberg, 2004).
Fan, C. et al. Plug-and-play stability for intracortical brain-computer interfaces: a one-year demonstration of seamless brain-to-text communication. Conference on Neural Information Processing Systems 37 (2023).
Wilson, G. H. et al. Long-term unsupervised recalibration of cursor BCIs. bioRxiv https://doi.org/10.1101/2023.02.03.527022 (2023).
Kim, S.-P., Wood, F., Fellows, M., Donoghue, J. P. & Black, M. J. Statistical Analysis of the Non-stationarity of Neural Population Codes. In: The First IEEE/RAS-EMBS International Conference on Biomedical Robotics and Biomechatronics, 2006. BioRob 2006. 811–816 (IEEE, 2006).
Ahmadipour, P., Yang, Y., Chang, E. F. & Shanechi, M. M. Adaptive tracking of human ECoG network dynamics. J. Neural Eng. 18, 016011 (2021).
pubmed: 33624610
Driscoll, L. N., Duncker, L. & Harvey, C. D. Representational drift: emerging theories for continual learning and experimental future directions. Curr. Opin. Neurobiol. 76, 102609 (2022).
pubmed: 35939861
doi: 10.1016/j.conb.2022.102609
Chestek, C. A. et al. Long-term stability of neural prosthetic control signals from silicon cortical arrays in rhesus macaque motor cortex. J. Neural Eng. 8, 045005 (2011).
pubmed: 21775782
pmcid: 3644617
doi: 10.1088/1741-2560/8/4/045005
Gallego, J. A., Perich, M. G., Chowdhury, R. H., Solla, S. A. & Miller, L. E. Long-term stability of cortical population dynamics underlying consistent behavior. Nat. Neurosci. 23, 260–270 (2020).
pubmed: 31907438
pmcid: 7007364
doi: 10.1038/s41593-019-0555-4
Chestek, C. A. et al. Single-neuron stability during repeated reaching in macaque premotor cortex. J. Neurosci. 27, 10742–10750 (2007).
pubmed: 17913908
pmcid: 6672821
doi: 10.1523/JNEUROSCI.0959-07.2007
Carmena, J. M., Lebedev, M. A., Henriquez, C. S. & Nicolelis, M. A. L. Stable ensemble performance with single-neuron variability during reaching movements in primates. J. Neurosci. 25, 10712–10716 (2005).
pubmed: 16291944
pmcid: 6725856
doi: 10.1523/JNEUROSCI.2772-05.2005
Stevenson, I. H. et al. Statistical assessment of the stability of neural movement representations. J. Neurophysiol. 106, 764–774 (2011).
pubmed: 21613593
pmcid: 3154833
doi: 10.1152/jn.00626.2010
McGinley, M. J. et al. Waking state: rapid variations modulate neural and behavioral responses. Neuron 87, 1143–1161 (2015).
pubmed: 26402600
pmcid: 4718218
doi: 10.1016/j.neuron.2015.09.012
Vinck, M., Batista-Brito, R., Knoblich, U. & Cardin, J. A. Arousal and locomotion make distinct contributions to cortical activity patterns and visual encoding. Neuron 86, 740–754 (2015).
pubmed: 25892300
pmcid: 4425590
doi: 10.1016/j.neuron.2015.03.028
Hennig, J. A. et al. Learning is shaped by abrupt changes in neural engagement. Nat. Neurosci. 24, 727–736 (2021).
pubmed: 33782622
pmcid: 9820750
doi: 10.1038/s41593-021-00822-8
Barrese, J. C. et al. Failure mode analysis of silicon-based intracortical microelectrode arrays in non-human primates. J. Neural Eng. 10, 066014 (2013).
pubmed: 24216311
pmcid: 4868924
doi: 10.1088/1741-2560/10/6/066014
Woeppel, K. et al. Explant analysis of utah electrode arrays implanted in human cortex for brain-computer-interfaces. Front. Bioeng. Biotechnol. 9, 759711 (2021).
pubmed: 34950640
pmcid: 8688945
doi: 10.3389/fbioe.2021.759711
Santhanam, G. et al. HermesB: a continuous neural recording system for freely behaving primates. IEEE Trans. Biomed. Eng. 54, 2037–2050 (2007).
pubmed: 18018699
doi: 10.1109/TBME.2007.895753
Gilja, V. et al. A high-performance neural prosthesis enabled by control algorithm design. Nat. Neurosci. 15, 1752–1757 (2012).
pubmed: 23160043
pmcid: 3638087
doi: 10.1038/nn.3265
Bishop, W. et al. Self-recalibrating classifiers for intracortical brain-computer interfaces. J. Neural Eng. 11, 026001 (2014).
pubmed: 24503597
pmcid: 4393645
doi: 10.1088/1741-2560/11/2/026001
Jarosiewicz, B. et al. Retrospectively supervised click decoder calibration for self-calibrating point-and-click brain-computer interfaces. J. Physiol. Paris 110, 382–391 (2016).
pubmed: 28286237
doi: 10.1016/j.jphysparis.2017.03.001
Brandman, D. M. et al. Robust closed-loop control of a cursor in a person with tetraplegia using Gaussian process regression. Neural Comput. 30, 2986–3008 (2018).
Farshchian, A. et al. Adversarial domain adaptation for stable brain-machine interfaces. International Conference on Learning Representations (ICLR, 2019).
Burkhart, M. C., Brandman, D. M., Franco, B., Hochberg, L. R. & Harrison, M. T. The discriminative Kalman filter For Bayesian filtering with nonlinear and nongaussian observation models. Neural Comput. 32, 969–1017 (2020).
pubmed: 32187000
pmcid: 8259355
doi: 10.1162/neco_a_01275
Ma, X. et al. Using adversarial networks to extend brain computer interface decoding accuracy over time. Elife 12, e84296 (2023).
Karpowicz, B. M. et al. Stabilizing brain-computer interfaces through alignment of latent dynamics. bioRxiv https://doi.org/10.1101/2022.04.06.487388 (2022).
Jude, J., Perich, M. G., Miller, L. E. & Hennig, M. H. Capturing cross-session neural population variability through self-supervised identification of consistent neuron ensembles. In: Proceedings of the 1st NeurIPS Workshop on Symmetry and Geometry in Neural Representations (eds. Sanborn, S., Shewmake, C., Azeglio, S., Di Bernardo, A. & Miolane, N.) vol. 197 234–257 (PMLR, 2023).
Hosman, T., Pun, T. K., Kapitonava, A., Simeral, J. D. & Hochberg, L. R. Months-long high-performance fixed LSTM decoder for cursor control in human intracortical brain-computer interfaces. In: 2023 11th International IEEE/EMBS Conference on Neural Engineering (NER) (IEEE, 2023).
Homer, M. L. et al. Adaptive offset correction for intracortical brain–computer interfaces. IEEE Trans. Neural Syst. Rehabil. Eng. 22, 239–248 (2014).
pubmed: 24196868
pmcid: 4117314
doi: 10.1109/TNSRE.2013.2287768
Kim, S.-P., Simeral, J. D., Hochberg, L. R., Donoghue, J. P. & Black, M. J. Neural control of computer cursor velocity by decoding motor cortical spiking activity in humans with tetraplegia. J. Neural Eng. 5, 455–476 (2008).
pubmed: 19015583
pmcid: 2911243
doi: 10.1088/1741-2560/5/4/010
Rokni, U., Richardson, A. G., Bizzi, E. & Seung, H. S. Motor learning with unstable neural representations. Neuron 54, 653–666 (2007).
pubmed: 17521576
doi: 10.1016/j.neuron.2007.04.030
Truccolo, W., Friehs, G. M., Donoghue, J. P. & Hochberg, L. R. Primary motor cortex tuning to intended movement kinematics in humans with tetraplegia. J. Neurosci. 28, 1163–1178 (2008).
pubmed: 18234894
pmcid: 6671402
doi: 10.1523/JNEUROSCI.4415-07.2008
Ganguly, K. & Carmena, J. M. Emergence of a stable cortical map for neuroprosthetic control. PLoS Biol. 7, e1000153 (2009).
pubmed: 19621062
pmcid: 2702684
doi: 10.1371/journal.pbio.1000153
Georgopoulos, A. P., Kalaska, J. F., Caminiti, R. & Massey, J. T. On the relations between the direction of two-dimensional arm movements and cell discharge in primate motor cortex. J. Neurosci. 2, 1527–1537 (1982).
pubmed: 7143039
pmcid: 6564361
doi: 10.1523/JNEUROSCI.02-11-01527.1982
Orsborn, A. L. et al. Closed-loop decoder adaptation shapes neural plasticity for skillful neuroprosthetic control. Neuron 82, 1380–1393 (2014).
pubmed: 24945777
doi: 10.1016/j.neuron.2014.04.048
Kobak, D. et al. Demixed principal component analysis of neural population data. Elife 5, e10989 (2016).
pubmed: 27067378
pmcid: 4887222
doi: 10.7554/eLife.10989
Downey, J. E. et al. Motor cortical activity changes during neuroprosthetic-controlled object interaction. Sci. Rep. 7, 16947 (2017).
pubmed: 29209023
pmcid: 5717217
doi: 10.1038/s41598-017-17222-3
Gallego, J. A. et al. Cortical population activity within a preserved neural manifold underlies multiple motor behaviors. Nat. Commun. 9, 4233 (2018).
pubmed: 30315158
pmcid: 6185944
doi: 10.1038/s41467-018-06560-z
Fraser, G. W., Chase, S. M., Whitford, A. & Schwartz, A. B. Control of a brain–computer interface without spike sorting. J. Neural Eng. 6, 055004 (2009).
pubmed: 19721186
doi: 10.1088/1741-2560/6/5/055004
Masse, N. Y. et al. Non-causal spike filtering improves decoding of movement intention for intracortical BCIs. J. Neurosci. Methods 236, 58–67 (2014).
pubmed: 25128256
pmcid: 4169749
doi: 10.1016/j.jneumeth.2014.08.004
Todorova, S., Sadtler, P., Batista, A., Chase, S. & Ventura, V. To sort or not to sort: the impact of spike-sorting on neural decoding performance. J. Neural Eng. 11, 056005 (2014).
pubmed: 25082508
pmcid: 4454741
doi: 10.1088/1741-2560/11/5/056005
Christie, B. P. et al. Comparison of spike sorting and thresholding of voltage waveforms for intracortical brain-machine interface performance. J. Neural Eng. 12, 016009 (2015).
pubmed: 25504690
doi: 10.1088/1741-2560/12/1/016009
Jarosiewicz, B. et al. Functional network reorganization during learning in a brain-computer interface paradigm. Proc. Natl. Acad. Sci. USA 105, 19486–19491 (2008).
pubmed: 19047633
pmcid: 2614787
doi: 10.1073/pnas.0808113105
Golub, M. D. et al. Learning by neural reassociation. Nat. Neurosci. 21, 607–616 (2018).
pubmed: 29531364
pmcid: 5876156
doi: 10.1038/s41593-018-0095-3
Oby, E. R. et al. New neural activity patterns emerge with long-term learning. Proc. Natl. Acad. Sci. USA 116, 15210–15215 (2019).
pubmed: 31182595
pmcid: 6660765
doi: 10.1073/pnas.1820296116
Jarosiewicz, B. et al. Advantages of closed-loop calibration in intracortical brain-computer interfaces for people with tetraplegia. J. Neural Eng. 10, 046012 (2013).
pubmed: 23838067
pmcid: 3775656
doi: 10.1088/1741-2560/10/4/046012
Shanechi, M. M. et al. A real-time brain-machine interface combining motor target and trajectory intent using an optimal feedback control design. PLoS ONE 8, e59049 (2013).
pubmed: 23593130
pmcid: 3622681
doi: 10.1371/journal.pone.0059049
Simeral, J. D. et al. Home use of a percutaneous wireless intracortical brain-computer interface by individuals with tetraplegia. IEEE Trans. Biomed. Eng. 68, 2313–2325 (2021).
pubmed: 33784612
pmcid: 8218873
doi: 10.1109/TBME.2021.3069119
Hochreiter, S. & Schmidhuber, J. Long short-term memory. Neural Comput. 9, 1735–1780 (1997).
pubmed: 9377276
doi: 10.1162/neco.1997.9.8.1735
Tseng, P.-H., Urpi, N. A., Lebedev, M. & Nicolelis, M. Decoding movements from cortical ensemble activity using a long short-term memory recurrent network. Neural Comput. 31, 1085–1113 (2019).
pubmed: 30979355
doi: 10.1162/neco_a_01189
Premchand, B. et al. Decoding movement direction from cortical microelectrode recordings using an LSTM-based neural network. In: 2020 42nd Annual International Conference of the IEEE Engineering in Medicine Biology Society (EMBC) 3007–3010 (IEEE, 2020).
Hosman, T. et al. BCI decoder performance comparison of an LSTM recurrent neural network and a Kalman filter in retrospective simulation. 9th International IEEE/EMBS Conference on Neural Engineering (NER) 1066–1071 (IEEE, 2019).
Berens, P. CircStat: a MATLAB toolbox for circular statistics. J. Stat. Softw. 31, 1–21 (2009).
doi: 10.18637/jss.v031.i10