Your browser doesn't support javascript.
loading
An instantaneous voice synthesis neuroprosthesis.
Wairagkar, Maitreyee; Card, Nicholas S; Singer-Clark, Tyler; Hou, Xianda; Iacobacci, Carrina; Hochberg, Leigh R; Brandman, David M; Stavisky, Sergey D.
Afiliación
  • Wairagkar M; Department of Neurological Surgery, University of California Davis, Davis, CA.
  • Card NS; Department of Neurological Surgery, University of California Davis, Davis, CA.
  • Singer-Clark T; Department of Neurological Surgery, University of California Davis, Davis, CA.
  • Hou X; Department of Biomedical Engineering, University of California Davis, Davis, CA.
  • Iacobacci C; Department of Neurological Surgery, University of California Davis, Davis, CA.
  • Hochberg LR; Department of Computer Science, University of California Davis, Davis, CA.
  • Brandman DM; Department of Neurological Surgery, University of California Davis, Davis, CA.
  • Stavisky SD; School of Engineering and Carney Institute for Brain Sciences, Brown University, Providence, RI.
bioRxiv ; 2024 Aug 19.
Article en En | MEDLINE | ID: mdl-39229047
ABSTRACT
Brain computer interfaces (BCIs) have the potential to restore communication to people who have lost the ability to speak due to neurological disease or injury. BCIs have been used to translate the neural correlates of attempted speech into text1-3. However, text communication fails to capture the nuances of human speech such as prosody, intonation and immediately hearing one's own voice. Here, we demonstrate a "brain-to-voice" neuroprosthesis that instantaneously synthesizes voice with closed-loop audio feedback by decoding neural activity from 256 microelectrodes implanted into the ventral precentral gyrus of a man with amyotrophic lateral sclerosis and severe dysarthria. We overcame the challenge of lacking ground-truth speech for training the neural decoder and were able to accurately synthesize his voice. Along with phonemic content, we were also able to decode paralinguistic features from intracortical activity, enabling the participant to modulate his BCI-synthesized voice in real-time to change intonation, emphasize words, and sing short melodies. These results demonstrate the feasibility of enabling people with paralysis to speak intelligibly and expressively through a BCI.
Texto completo
Añadir a Mi BVS
Imprimir
XML
PubMed Links
Buscar en Google

Texto completo: 1 Colección: 01-internacional Base de datos: MEDLINE Idioma: En Revista: BioRxiv Año: 2024 Tipo del documento: Article País de afiliación: Canadá Pais de publicación: Estados Unidos
Texto completo
Añadir a Mi BVS
Imprimir
XML
PubMed Links
Buscar en Google

Texto completo: 1 Colección: 01-internacional Base de datos: MEDLINE Idioma: En Revista: BioRxiv Año: 2024 Tipo del documento: Article País de afiliación: Canadá Pais de publicación: Estados Unidos