MIT Libraries logoDSpace@MIT

MIT
View Item 
  • DSpace@MIT Home
  • MIT Open Access Articles
  • MIT Open Access Articles
  • View Item
  • DSpace@MIT Home
  • MIT Open Access Articles
  • MIT Open Access Articles
  • View Item
JavaScript is disabled for your browser. Some features of this site may not work without it.

A Wireless Brain-Machine Interface for Real-Time Speech Synthesis

Author(s)
Guenther, Frank H.; Brumberg, Jonathan S.; Wright, E. Joseph; Nieto-Castanon, Alfonso; Tourville, Jason A.; Panko, Mikhail; Law, Robert; Siebert, Steven A.; Bartels, Jess L.; Andreasen, Dinal S.; Ehirim, Princewill; Mao, Hui; Kennedy, Philip R.; ... Show more Show less
Thumbnail
DownloadGuenther-2009-A Wireless Brain-Machine Interface for Real-Time Speech Synthesis.pdf (1.871Mb)
PUBLISHER_CC

Publisher with Creative Commons License

Creative Commons Attribution

Terms of use
Creative Commons Attribution http://creativecommons.org/licenses/by/2.5/
Metadata
Show full item record
Abstract
Background: Brain-machine interfaces (BMIs) involving electrodes implanted into the human cerebral cortex have recently been developed in an attempt to restore function to profoundly paralyzed individuals. Current BMIs for restoring communication can provide important capabilities via a typing process, but unfortunately they are only capable of slow communication rates. In the current study we use a novel approach to speech restoration in which we decode continuous auditory parameters for a real-time speech synthesizer from neuronal activity in motor cortex during attempted speech. Methodology/Principal Findings: Neural signals recorded by a Neurotrophic Electrode implanted in a speech-related region of the left precentral gyrus of a human volunteer suffering from locked-in syndrome, characterized by near-total paralysis with spared cognition, were transmitted wirelessly across the scalp and used to drive a speech synthesizer. A Kalman filter-based decoder translated the neural signals generated during attempted speech into continuous parameters for controlling a synthesizer that provided immediate (within 50 ms) auditory feedback of the decoded sound. Accuracy of the volunteer's vowel productions with the synthesizer improved quickly with practice, with a 25% improvement in average hit rate (from 45% to 70%) and 46% decrease in average endpoint error from the first to the last block of a three-vowel task. Conclusions/Significance: Our results support the feasibility of neural prostheses that may have the potential to provide near-conversational synthetic speech output for individuals with severely impaired speech motor control. They also provide an initial glimpse into the functional properties of neurons in speech motor cortical areas.
Date issued
2009-12
URI
http://hdl.handle.net/1721.1/64994
Department
Harvard University--MIT Division of Health Sciences and Technology; Picower Institute for Learning and Memory
Journal
PLoS ONE
Publisher
Public Library of Science
Citation
Guenther, Frank H. et al. “A Wireless Brain-Machine Interface for Real-Time Speech Synthesis.” Ed. Eshel Ben-Jacob. PLoS ONE 4.12 (2009) : e8218. © 2009 Guenther et al.
Version: Final published version
ISSN
1932-6203

Collections
  • MIT Open Access Articles

Browse

All of DSpaceCommunities & CollectionsBy Issue DateAuthorsTitlesSubjectsThis CollectionBy Issue DateAuthorsTitlesSubjects

My Account

Login

Statistics

OA StatisticsStatistics by CountryStatistics by Department
MIT Libraries
PrivacyPermissionsAccessibilityContact us
MIT
Content created by the MIT Libraries, CC BY-NC unless otherwise noted. Notify us about copyright concerns.