Advanced Search

FMRI studies of effects of hearing status on audio-visual speech perception

Research and Teaching Output of the MIT Community

Planned maintenance alert - Monday, April 21: DSpace@MIT will undergo maintenance activities that will affect service availability and access to file content. While the service interruptions should be brief, access to file content may take longer to restore. Status updates will be posted to

Show simple item record

dc.contributor.advisor Frank H. Guenther. en_US Yoo, Julie J en_US
dc.contributor.other Harvard University--MIT Division of Health Sciences and Technology. en_US 2008-11-10T19:49:34Z 2008-11-10T19:49:34Z 2007 en_US 2007 en_US
dc.identifier.uri en_US
dc.description Thesis (Ph. D.)--Harvard-MIT Division of Health Sciences and Technology, 2007. en_US
dc.description Includes bibliographical references (leaves 158-172). en_US
dc.description.abstract The overall goal of this research is to acquire a more complete picture of the neurological processes of visual influences on speech perception and to investigate effects of hearing status on AV speech perception. More specifically, functional magnetic resonance imaging (fMRI) was used to investigate the brain activity underlying audio-visual speech perception in three groups of subjects: (1) normally hearing, (2) congenitally deafened signers (American Sign Language) who do not use hearing aids, and (3) congenitally hearing impaired individuals with hearing aids. FMRI data were collected while subjects experienced three different types of speech stimuli: video of a speaking face with audio input, audio speech without visual input, and video of a speaking face without audio input. The cortical areas found to be active for speechreading included: visual cortex, auditory cortex (but not primary auditory cortex), speech motor network areas, supramarginal gyrus, thalamus, superior parietal cortex and fusiform gyrus. For hearing impaired subjects, in addition to the areas listed above, Heschl's gyrus, right angular gyrus (AG), cerebellum and regions around right inferior frontal sulcus (IFS) in the frontal lobe were also found to be active. en_US
dc.description.abstract (cont.) Results from our study added to existing evidence of the engagement of motor-articulatory strategies in visual speech perception. We also found that an individual's speechreading ability is related to the amount of activity in superior temporal cortical areas, including primary auditory cortex, pre-SMA, IFS and right AG during visual speech perception. Results from effective connectivity analyses suggest that posterior superior temporal sulcus may be a potential AV speech integration site; and that AG serves a critical role in visual speech perception when auditory information is absent for hearing subjects, and when auditory information is available for hearing impaired subjects. Also, strong excitatory projections from STS to inferior frontal gyrus (IFG) and premotor/motor areas, and a strong inhibitory projection from IFG to STS seem to play an important role in visual speech perception in all subject groups. Finally, correlation analyses revealed that in hearing aid users, the amount of acoustic and speech signal gained by using hearing aids were significantly correlated with activity in IFG. en_US
dc.description.statementofresponsibility by Julie J. Yoo. en_US
dc.format.extent 172 leaves en_US
dc.language.iso eng en_US
dc.publisher Massachusetts Institute of Technology en_US
dc.rights M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission. en_US
dc.rights.uri en_US
dc.rights.uri en_US
dc.subject Harvard University--MIT Division of Health Sciences and Technology. en_US
dc.title FMRI studies of effects of hearing status on audio-visual speech perception en_US
dc.title.alternative Functional magnetic resonance imaging studies of effects of hearing status on audio-visual speech perception en_US
dc.type Thesis en_US Ph.D. en_US
dc.contributor.department Harvard University--MIT Division of Health Sciences and Technology. en_US
dc.identifier.oclc 156884078 en_US

Files in this item

Name Size Format Description
156884078.pdf 15.51Mb PDF Preview, non-printable (open to all)
156884078-MIT.pdf 15.51Mb PDF Full printable version (MIT only)

This item appears in the following Collection(s)

Show simple item record