Stable Decoding from a Speech BCI Enables Control for an Individual with ALS without Recalibration for 3 Months.

amyotrophic lateral sclerosis (ALS) brain-computer interfaces neural decoding speech brain-computer interface (BCI)

Journal

Advanced science (Weinheim, Baden-Wurttemberg, Germany)
ISSN: 2198-3844
Titre abrégé: Adv Sci (Weinh)
Pays: Germany
ID NLM: 101664569

Informations de publication

Date de publication:
24 Oct 2023
Historique:
revised: 18 09 2023
received: 17 07 2023
medline: 25 10 2023
pubmed: 25 10 2023
entrez: 24 10 2023
Statut: aheadofprint

Résumé

Brain-computer interfaces (BCIs) can be used to control assistive devices by patients with neurological disorders like amyotrophic lateral sclerosis (ALS) that limit speech and movement. For assistive control, it is desirable for BCI systems to be accurate and reliable, preferably with minimal setup time. In this study, a participant with severe dysarthria due to ALS operates computer applications with six intuitive speech commands via a chronic electrocorticographic (ECoG) implant over the ventral sensorimotor cortex. Speech commands are accurately detected and decoded (median accuracy: 90.59%) throughout a 3-month study period without model retraining or recalibration. Use of the BCI does not require exogenous timing cues, enabling the participant to issue self-paced commands at will. These results demonstrate that a chronically implanted ECoG-based speech BCI can reliably control assistive devices over long time periods with only initial model training and calibration, supporting the feasibility of unassisted home use.

Identifiants

pubmed: 37875404
doi: 10.1002/advs.202304853
doi:

Types de publication

Journal Article

Langues

eng

Sous-ensembles de citation

IM

Pagination

e2304853

Subventions

Organisme : NIDCD NIH HHS
ID : U01DC016686
Pays : United States
Organisme : NINDS NIH HHS
ID : UH3NS114439
Pays : United States

Informations de copyright

© 2023 The Authors. Advanced Science published by Wiley-VCH GmbH.

Références

J. S. Brumberg, A. Nieto-Castanon, P. R. Kennedy, F. H. Guenther, Speech Commun. 2010, 52, 367.
J. R. Wolpaw, N. Birbaumer, D. J. Mcfarland, G. Pfurtscheller, T. M. Vaughan, Clin. Neurophysiol. 2002, 113, 767.
M. J. Vansteensel, E. G. M. Pels, M. G. Bleichner, M. P. Branco, T. Denison, Z. V. Freudenburg, P. Gosselaar, S. Leinders, T. H. Ottens, M. A. Van Den Boom, P. C. Van Rijen, E. J. Aarnoutse, N. F. Ramsey, N. Engl. J. Med. 2016, 375, 2060.
C. Pandarinath, P. Nuyujukian, C. H. Blabe, B. L. Sorice, J. Saab, F. R. Willett, L. R. Hochberg, K. V. Shenoy, J. M. Henderson, eLife 2017, 6, e18554.
A. Greenberg, A. Cohen, M. Grewal, Nat. Biotechnol. 2021, 39, 1194.
G. K. Anumanchipalli, J. Chartier, E. F. Chang, Nature 2019, 568, 493.
D. A. Moses, S. L. Metzger, J. R. Liu, G. K. Anumanchipalli, J. G. Makin, P. F. Sun, J. Chartier, M. E. Dougherty, P. M. Liu, G. M. Abrams, A. Tu-Chan, K. Ganguly, E. F. Chang, N. Engl. J. Med. 2021, 385, 217.
M. Angrick, C. Herff, E. Mugler, M. C. Tate, M. W. Slutzky, D. J. Krusienski, T. Schultz, J. Neural Eng. 2019, 16, 036019.
C. Herff, L. Diener, M. Angrick, E. Mugler, M. C. Tate, M. A. Goldrick, D. J. Krusienski, M. W. Slutzky, T. Schultz, Front. Neurosci. 2019, 13, 1267.
E. M. Mugler, J. L. Patton, R. D. Flint, Z. A. Wright, S. U. Schuele, J. Rosenow, J. J. Shih, D. J. Krusienski, M. W. Slutzky, J. Neural Eng. 2014, 11, 035015.
C. Herff, D. Heger, A. De Pesters, D. Telaar, P. Brunner, G. Schalk, T. Schultz, Front. Neurosci. 2015, 8, 217.
J. G. Makin, D. A. Moses, E. F. Chang, Nat. Neurosci. 2020, 23, 575.
F. H. Guenther, J. S. Brumberg, E. J. Wright, A. Nieto-Castanon, J. A. Tourville, M. Panko, R. Law, S. A. Siebert, J. L. Bartels, D. S. Andreasen, P. Ehirim, H. Mao, P. R. Kennedy, PLoS One 2009, 4, e8218.
T. Proix, J. Delgado Saa, A. Christen, S. Martin, B. N. Pasley, R. T. Knight, X. Tian, D. Poeppel, W. K. Doyle, O. Devinsky, L. H. Arnal, P. Mégevand, A.-L. Giraud, Nat. Commun. 2022, 13, 48.
M. P. Branco, E. G. M. Pels, R. H. Sars, E. J. Aarnoutse, N. F. Ramsey, M. J. Vansteensel, F. Nijboer, Neurorehabilit. Neural Repair 2021, 35, 267.
F. R. Willett, D. T. Avansino, L. R. Hochberg, J. M. Henderson, K. V. Shenoy, Nature 2021, 593, 249.
A. L. Benabid, T. Costecalde, A. Eliseyev, G. Charvet, A. Verney, S. Karakas, M. Foerster, A. Lambert, B. Morinière, N. Abroug, M.-C. Schaeffer, A. Moly, F. Sauter-Starace, D. Ratel, C. Moro, N. Torres-Martinez, L. Langar, M. Oddoux, M. Polosan, S. Pezzani, V. Auboiroux, T. Aksenova, C. Mestais, S. Chabardes, Lancet Neurol. 2019, 18, 1112.
D. M. Brandman, T. Hosman, J. Saab, M. C. Burkhart, B. E. Shanahan, J. G. Ciancibello, A. A. Sarma, D. J. Milstein, C. E. Vargas-Irwin, B. Franco, J. Kelemen, C. Blabe, B. A. Murphy, D. R. Young, F. R. Willett, C. Pandarinath, S. D. Stavisky, R. F. Kirsch, B. L. Walter, A. Bolu Ajiboye, S. S. Cash, E. N. Eskandar, J. P. Miller, J. A. Sweet, K. V. Shenoy, J. M. Henderson, B. Jarosiewicz, M. T. Harrison, J. D. Simeral, L. R. Hochberg, J. Neural Eng. 2018, 15, 026007.
D. Sussillo, S. D. Stavisky, J. C. Kao, S. I. Ryu, K. V. Shenoy, Nat. Commun. 2016, 7, 13749.
D. B. Silversmith, R. Abiri, N. F. Hardy, N. Natraj, A. Tu-Chan, E. F. Chang, K. Ganguly, Nat. Biotechnol. 2021, 39, 326.
N. Crone, D. Miglioretti, B. Gordon, R. Lesser, Brain 1998, 121, 2301.
S. Ray, N. E. Crone, E. Niebur, P. J. Franaszczuk, S. S. Hsiao, J. Neurosci. 2008, 28, 11526.
G. Buzsáki, C. A. Anastassiou, C. Koch, Nat. Rev. Neurosci. 2012, 13, 407.
D. A. Moses, M. K. Leonard, J. G. Makin, E. F. Chang, Nat. Commun. 2019, 10, 3096.
H. I. Fawaz, B. Lucas, G. Forestier, C. Pelletier, D. F. Schmidt, J. Weber, G. I. Webb, L. Idoumghar, P.-A. Muller, F. Petitjean, Data Min. Knowl. Discov. 2020, 34, 1936.
K. Simonyan, A. Vedaldi, A. Zisserman, presented at Proc. of the Int. Conf. on Learning Representations (ICLR), Banff, Canada, April 2014.
K. E. Bouchard, N. Mesgarani, K. Johnson, E. F. Chang, Nature 2013, 495, 327.
S. L. Metzger, J. R. Liu, D. A. Moses, M. E. Dougherty, M. P. Seaton, K. T. Littlejohn, J. Chartier, G. K. Anumanchipalli, A. Tu-Chan, K. Ganguly, E. F. Chang, Nat. Commun. 2022, 13, 6510.
J. E. Huggins, P. A. Wren, K. L. Gruis, Amyotroph. Lateral Sc. 2011, 12, 318.
A. D. Degenhart, W. E. Bishop, E. R. Oby, E. C. Tyler-Kabara, S. M. Chase, A. P. Batista, B. M. Yu, Nat. Biomed. Eng. 2020, 4, 672.
K. T. Jensen, N. Kadmon Harpaz, A. K. Dhawale, S. B. E. Wolff, B. P. Ölveczky, Nat. Neurosci. 2022, 25, 1664.
J. A. Gallego, M. G. Perich, R. H. Chowdhury, S. A. Solla, L. E. Miller, Nat. Neurosci. 2020, 23, 260.
A. Moly, T. Costecalde, F. Martel, M. Martin, C. Larzabal, S. Karakas, A. Verney, G. Charvet, S. Chabardes, A. L. Benabid, T. Aksenova, J. Neural Eng. 2022, 19, 026021.
V. R. Rao, M. K. Leonard, J. K. Kleen, B. A. Lucas, E. A. Mirro, E. F. Chang, NeuroImage 2017, 153, 273.
H. Lorach, A. Galvez, V. Spagnolo, F. Martel, S. Karakas, N. Intering, M. Vat, O. Faivre, C. Harte, S. Komi, J. Ravier, T. Collin, L. Coquoz, I. Sakr, E. Baaklini, S. D. Hernandez-Charpak, G. Dumont, R. Buschman, N. Buse, T. Denison, I. van Nes, L. Asboth, A. Watrin, L. Struber, F. Sauter-Starace, L. Langar, V. Auboiroux, S. Carda, S. Chabardes, T. Aksenova, et al., Nature 2023, 618, 126.
Z. Chao, Y. Nagasaka, N. Fujii, Front. Neuroeng. 2010, 3, 3.
A. D. Degenhart, J. Eles, R. Dum, J. L. Mischel, I. Smalianchuk, B. Endler, R. C. Ashmore, E. C. Tyler-Kabara, N. G. Hatsopoulos, W. Wang, A. P. Batista, X. T. Cui, J. Neural Eng. 2016, 13, 046019.
G. Milsap, M. Collard, C. Coogan, Q. Rabbani, Y. Wang, N. E. Crone, Front. Neurosci. 2019, 13, 60.
B. Kashyap, M. Horne, P. N. Pathirana, L. Power, D. Szmulewicz, Biomed. Signal Process. Control 2020, 57, 101759.
C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, A. Rabinovich, presented at IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), Boston, Massachusetts, USA, June 2015.
D. P. Kingma, J. Ba, arXiv:1412.6980 2017, https://doi.org/10.48550/arXiv.1412.6980.
P. Hintjens, O'Reilly Media, Inc., Sebastopol, CA, 2013.
G. Schalk, D. J. Mcfarland, T. Hinterberger, N. Birbaumer, J. R. Wolpaw, IEEE Trans. Biomed. Eng. 2004, 51, 1034.
B. Fischl, NeuroImage 2012, 62, 774.
P. Roussel, G. L. Godais, F. Bocquelet, M. Palma, J. Hongjie, S. Zhang, A.-L. Giraud, P. Mégevand, K. Miller, J. Gehrig, C. Kell, P. Kahane, S. Chabardés, B. Yvert, J. Neural Eng. 2020, 17, 056028.
A. Bush, A. Chrabaszcz, V. Peterson, V. Saravanan, C. Dastolfo-Hromack, W. J. Lipski, R. M. Richardson, NeuroImage 2022, 250, 118962.
G. H. Wilson, S. D. Stavisky, F. R. Willett, D. T. Avansino, J. N. Kelemen, L. R. Hochberg, J. M. Henderson, S. Druckmann, K. V. Shenoy, J. Neural Eng. 2020, 17, 066007.

Auteurs

Shiyu Luo (S)

Department of Biomedical Engineering, Johns Hopkins University School of Medicine, Baltimore, MD, 21205, USA.

Miguel Angrick (M)

Department of Neurology, Johns Hopkins University School of Medicine, Baltimore, MD, 21287, USA.

Christopher Coogan (C)

Department of Neurology, Johns Hopkins University School of Medicine, Baltimore, MD, 21287, USA.

Daniel N Candrea (DN)

Department of Biomedical Engineering, Johns Hopkins University School of Medicine, Baltimore, MD, 21205, USA.

Kimberley Wyse-Sookoo (K)

Department of Biomedical Engineering, Johns Hopkins University School of Medicine, Baltimore, MD, 21205, USA.

Samyak Shah (S)

Department of Neurology, Johns Hopkins University School of Medicine, Baltimore, MD, 21287, USA.

Qinwan Rabbani (Q)

Department of Electrical and Computer Engineering, Johns Hopkins University, Baltimore, MD, 21218, USA.
Center for Language and Speech Processing, Johns Hopkins University, Baltimore, MD, 21218, USA.

Griffin W Milsap (GW)

Research and Exploratory Development Department, Johns Hopkins University Applied Physics Laboratory, Laurel, MD, 20723, USA.

Alexander R Weiss (AR)

Department of Neurology, Johns Hopkins University School of Medicine, Baltimore, MD, 21287, USA.

William S Anderson (WS)

Department of Neurosurgery, Johns Hopkins University School of Medicine, Baltimore, MD, 21205, USA.

Donna C Tippett (DC)

Department of Neurology, Johns Hopkins University School of Medicine, Baltimore, MD, 21287, USA.
Department of Otolaryngology-Head and Neck Surgery, Johns Hopkins University School of Medicine, Baltimore, MD, 21205, USA.
Department of Physical Medicine and Rehabilitation, Johns Hopkins University School of Medicine, Baltimore, MD, 21205, USA.

Nicholas J Maragakis (NJ)

Department of Neurology, Johns Hopkins University School of Medicine, Baltimore, MD, 21287, USA.

Lora L Clawson (LL)

Department of Neurology, Johns Hopkins University School of Medicine, Baltimore, MD, 21287, USA.

Mariska J Vansteensel (MJ)

Department of Neurology and Neurosurgery, UMC Utrecht Brain Center, Utrecht, 3584, The Netherlands.

Brock A Wester (BA)

Research and Exploratory Development Department, Johns Hopkins University Applied Physics Laboratory, Laurel, MD, 20723, USA.

Francesco V Tenore (FV)

Research and Exploratory Development Department, Johns Hopkins University Applied Physics Laboratory, Laurel, MD, 20723, USA.

Hynek Hermansky (H)

Department of Electrical and Computer Engineering, Johns Hopkins University, Baltimore, MD, 21218, USA.
Center for Language and Speech Processing, Johns Hopkins University, Baltimore, MD, 21218, USA.

Matthew S Fifer (MS)

Research and Exploratory Development Department, Johns Hopkins University Applied Physics Laboratory, Laurel, MD, 20723, USA.

Nick F Ramsey (NF)

Department of Neurology and Neurosurgery, UMC Utrecht Brain Center, Utrecht, 3584, The Netherlands.

Nathan E Crone (NE)

Department of Neurology, Johns Hopkins University School of Medicine, Baltimore, MD, 21287, USA.

Classifications MeSH