Narratarium : real-time context-based sound and color extraction from text
Name
870969861-MIT.pdf
Description
Full printable version
Size
5.28 MB
Format
Adobe PDF
Checksum (MD5)
00cb76e9c64c0d8ab0f538b5fccef057
Author(s)
Peng, Timothy, M. Eng. Massachusetts Institute of Technology
Advisor(s)
Catherine Havasi.
Alternative Title
Real-time context-based sound and color extraction from text
Date Issued
2013
Publisher
Massachusetts Institute of Technology
Abstract
Narratarium is a system that uses English text or voice input, provided either realtime or off-line, to generate context-specific colors and sound effects. It accomplishes this by employing a variety of machine learning approaches, including commonsense reasoning and natural language processing. It can be highly customized to prioritize different performance metrics, most importantly accuracy and latency, and can be used with any tagged sound corpus. The final product allows users to tell a story in an immersive environment that augments the story-telling experience with thematic colors and background sounds. In this thesis, we present the back-end logic that generates best guesses for contextual colors and sound using text input. We evaluate the performance of these algorithms under different configurations, and demonstrate that performance is acceptable for realistic user scenarios. We also discuss Narratarium's overall design.
Description
Thesis: M. Eng., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2013.
Cataloged from PDF version of thesis.
Includes bibliographical references (page 69).
Subjects
Electrical Engineering and Computer Science.
MIT Department
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Terms of Use
M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission.
Persistent DSpace Link
