Online speech synthesis using a chronically implanted brain-computer interface in an individual with ALS.

Journal

medRxiv : the preprint server for health sciences
Titre abrégé: medRxiv
Pays: United States
ID NLM: 101767986

Informations de publication

Date de publication:
01 Jul 2023
Historique:
pubmed: 10 7 2023
medline: 10 7 2023
entrez: 10 7 2023
Statut: epublish

Résumé

Recent studies have shown that speech can be reconstructed and synthesized using only brain activity recorded with intracranial electrodes, but until now this has only been done using retrospective analyses of recordings from able-bodied patients temporarily implanted with electrodes for epilepsy surgery. Here, we report online synthesis of intelligible words using a chronically implanted brain-computer interface (BCI) in a clinical trial participant (ClinicalTrials.gov, NCT03567213) with dysarthria due to amyotrophic lateral sclerosis (ALS). We demonstrate a reliable BCI that synthesizes commands freely chosen and spoken by the user from a vocabulary of 6 keywords originally designed to allow intuitive selection of items on a communication board. Our results show for the first time that a speech-impaired individual with ALS can use a chronically implanted BCI to reliably produce synthesized words that are intelligible to human listeners while preserving the participants voice profile.

Identifiants

DOI: 10.1101/2023.06.30.23291352 PMID: 37425721 PMC: PMC10327279
pubmed: 37425721
doi: 10.1101/2023.06.30.23291352
pmc: PMC10327279
pii:
doi:

Banques de données

ClinicalTrials.gov
['NCT03567213']

Types de publication

Preprint

Langues

eng

Subventions

Organisme : NINDS NIH HHS
ID : UH3 NS114439
Pays : United States

Déclaration de conflit d'intérêts

Competing Interests The authors declare that they have no competing interests.

Auteurs

Miguel Angrick (M)

Department of Neurology, The Johns Hopkins University School of Medicine, Baltimore, MD, USA.

Shiyu Luo (S)

Department of Biomedical Engineering, The Johns Hopkins University School of Medicine, Baltimore, MD, USA.

Qinwan Rabbani (Q)

Department of Electrical and Computer Engineering, The Johns Hopkins University, Baltimore, MD, USA.

Daniel N Candrea (DN)

Department of Biomedical Engineering, The Johns Hopkins University School of Medicine, Baltimore, MD, USA.

Samyak Shah (S)

Department of Neurology, The Johns Hopkins University School of Medicine, Baltimore, MD, USA.

Griffin W Milsap (GW)

Research and Exploratory Development Department, Johns Hopkins Applied Physics Laboratory, Laurel, MD, USA.

William S Anderson (WS)

Department of Neurosurgery, The Johns Hopkins University School of Medicine, Baltimore, MD.

Chad R Gordon (CR)

Department of Neurosurgery, The Johns Hopkins University School of Medicine, Baltimore, MD.
Section of Neuroplastic and Reconstructive Surgery, Department of Plastic Surgery, The Johns Hopkins University School of Medicine, Baltimore, MD, USA.

Kathryn R Rosenblatt (KR)

Department of Neurology, The Johns Hopkins University School of Medicine, Baltimore, MD, USA.
Department of Anesthesiology & Critical Care Medicine, The Johns Hopkins University School of Medicine, Baltimore, MD, USA.

Lora Clawson (L)

Department of Neurology, The Johns Hopkins University School of Medicine, Baltimore, MD, USA.

Nicholas Maragakis (N)

Department of Neurology, The Johns Hopkins University School of Medicine, Baltimore, MD, USA.

Francesco V Tenore (FV)

Research and Exploratory Development Department, Johns Hopkins Applied Physics Laboratory, Laurel, MD, USA.

Matthew S Fifer (MS)

Research and Exploratory Development Department, Johns Hopkins Applied Physics Laboratory, Laurel, MD, USA.

Hynek Hermansky (H)

Center for Language and Speech Processing, The Johns Hopkins University, Baltimore, MD, USA.
Human Language Technology Center of Excellence, The Johns Hopkins University, Baltimore, MD, USA.

Nick F Ramsey (NF)

UMC Utrecht Brain Center, Department of Neurology and Neurosurgery, University Medical Center Utrecht, Utrecht, The Netherlands.

Nathan E Crone (NE)

Department of Neurology, The Johns Hopkins University School of Medicine, Baltimore, MD, USA.

Classifications MeSH