Grounding language models in spatiotemporal context
Name
RVR_interspeech2014.pdf
Size
497.59 KB
Format
Adobe PDF
Checksum (MD5)
23b60edae86f88a0102aba0c1c5cc973
Author(s)
Roy, Brandon C.
Vosoughi, Soroush
Roy, Deb K
Date Issued
September 2014
Journal
Proceedings of the 15th Annual Conference of the International Speech Communication Association
Publisher
International Speech Communication Association
Citation
Roy, Brandon C., Soroush Vosoughi, and Deb Roy. "Grounding language in spatiotemporal context." The 15th Annual Conference of the International Speech Communication Association, September 14-18, 2014.
Version
Author's final manuscript
Abstract
Natural language is rich and varied, but also highly structured. The rules of grammar are a primary source of linguistic regularity, but there are many other factors that govern patterns of language use. Language models attempt to capture linguistic regularities, typically by modeling the statistics of word use, thereby folding in some aspects of grammar and style. Spoken language is an important and interesting subset of natural language that is temporally and spatially grounded. While time and space may directly contribute to a speaker’s choice of words, they may also serve as indicators for communicative intent or other contextual and situational factors. To investigate the value of spatial and temporal information, we build a series of language models using a large, naturalistic corpus of spatially and temporally coded speech collected from a home environment. We incorporate this extralinguistic information by building spatiotemporal word classifiers that are mixed with traditional unigram and bigram models. Our evaluation shows that both perplexity and word error rate can be significantly improved by incorporating this information in a simple framework. The underlying principles of this work could be applied in a wide range of scenarios in which temporal or spatial information is available.
MIT Department
Program in Media Arts and Sciences (Massachusetts Institute of Technology)
Terms of Use
Creative Commons Attribution-Noncommercial-Share Alike
Persistent DSpace Link
DOI of Published Version
http://www.interspeech2014.org/public.php?page=program_details.html
