Panoptic
Name
1026502481-MIT.pdf
Description
Full printable version
Size
25.61 MB
Format
Adobe PDF
Checksum (MD5)
6a07b6d15da8a5f3fa9f121f4b575414
Author(s)
Sanchez Lengeling, Thomas
Advisor(s)
Tod Machover.
Date Issued
2017
Publisher
Massachusetts Institute of Technology
Abstract
Imagine traveling to a destination and, once you are there, hearing only car horns or seeing only a green sky. This project is an augmented reality experience in which you see and hear your current city while you are in another location through an immersive helmet. The multimodal experience includes augmented sounds and images that are generated by a semantic segmentation of your visual field. The segmentation produces overlaid sonic textures and superimposed visuals, modeling a newly perceived reality. The system presents cases where it is possible to imagine another place deeply and to become accustomed to a new location before being there physically. Moreover, one of the purposes of this thesis is to study the immersion of your current location but with distinct sounds and visuals from another location, for example, seeing colors and hearing sounds from Mexico City as if you were in Boston. The panoptic system aims to enhance human cognition and perception by using artificial intelligence through an immersive augmented reality device. Another goal is to augment your vision by knowing and understanding your surroundings. By using a Deep Learning model, the user's view is a "diminished" or an "augmented" reality, in which it is possible to manipulate and control physical reality in real time reality. In addition, the purpose is to offer a helpful, immersive, subjective - rather than a detached, observational - experience.
Description
Thesis: S.M., Massachusetts Institute of Technology, School of Architecture and Planning, Program in Media Arts and Sciences, 2017.
Cataloged from PDF version of thesis.
Includes bibliographical references (pages 117-123).
Subjects
Program in Media Arts and Sciences ()
MIT Department
Program in Media Arts and Sciences (Massachusetts Institute of Technology)
Terms of Use
MIT theses are protected by copyright. They may be viewed, downloaded, or printed from this source but further reproduction or distribution in any format is prohibited without written permission.
Persistent DSpace Link
