2026-09-20T00:15:31Zhttps://dspace.mit.edu/server/oai/requestoai:dspace.mit.edu:1721.1/1241962021-07-05T14:03:20Zcom_1721.1_7582com_1721.1_7581col_1721.1_131023
V. Michael Bove.
Parthiban, Vikraman.
Program in Media Arts and Sciences (Massachusetts Institute of Technology)
Program in Media Arts and Sciences (Massachusetts Institute of Technology)
2020-03-23T18:11:18Z
2020-03-23T18:11:18Z
2019
2019
https://hdl.handle.net/1721.1/124196
1145278341
Thesis: S.M., Massachusetts Institute of Technology, School of Architecture and Planning, Program in Media Arts and Sciences, 2019
Cataloged from PDF version of thesis.
Includes bibliographical references (pages 83-84).
With the rise of augmented and virtual reality, new interactive technologies are incorporating immersive user interfaces that leverage gesture and voice recognition in addition to existing controller inputs. However, the state-of-the-art interfaces are quite rudimentary and not widely accessible for the user. Such interfaces require significant amount of sensors, extensive calibration, and/or high latency in the gestural commands. LUI (Large User Interface) is a scalable, multimodal interface that uses a framework of nondiscrete, free-handed gestures and voice to control modular applications with a single stereo-camera and voice assistant. The gestures and voice input are mapped to web UI elements to provide a highly-responsive and accessible user experience. The menu screen consists of an extendable list of applications, currently including photos, YouTube, etc, which are navigated through the input framework. This interface can be deployed on an AR or VR system, heads-up displays for autonomous vehicles, and everyday large displays.
by Vikraman Parthiban.
S.M.
S.M. Massachusetts Institute of Technology, School of Architecture and Planning, Program in Media Arts and Sciences
84 pages
eng
Massachusetts Institute of Technology
MIT theses are protected by copyright. They may be viewed, downloaded, or printed from this source but further reproduction or distribution in any format is prohibited without written permission.
http://dspace.mit.edu/handle/1721.1/7582
Program in Media Arts and Sciences
LUI : a scalable, multimodal gesture- and voice-interface for large displays
Large User Interface : a scalable, multimodal gesture- and voice-interface for large displays
Scalable, multimodal gesture- and voice-interface for large displays
Thesis
application/pdf
2020-03-23T18:11:17Z
Publication
Master
Media
unknown
unknown
<Publication xmlns="https://www.openaire.eu/cerif-profile/1.1/" id="84073600-c2bc-44b4-a88f-703bc38f6d6e">
<Type xmlns="https://www.openaire.eu/cerif-profile/vocab/COAR_Publication_Types">http://purl.org/coar/resource_type/c_1843</Type>
<Language>eng</Language>
<Title>LUI : a scalable, multimodal gesture- and voice-interface for large displays</Title>
<Subtitle>Large User Interface : a scalable, multimodal gesture- and voice-interface for large displays</Subtitle>
<Subtitle>Scalable, multimodal gesture- and voice-interface for large displays</Subtitle>
<PublishedIn>
<Publication>
</Publication>
</PublishedIn>
<PublicationDate>2019</PublicationDate>
<Authors>
<Author>
<DisplayName>Parthiban, Vikraman.</DisplayName>
<Affiliation>
<OrgUnit>
</OrgUnit>
</Affiliation>
</Author>
</Authors>
<Editors>
</Editors>
<Publishers>
<Publisher>
<DisplayName>Massachusetts Institute of Technology</DisplayName>
<OrgUnit />
</Publisher>
</Publishers>
<License>http://dspace.mit.edu/handle/1721.1/7582</License>
<Keyword>Program in Media Arts and Sciences</Keyword>
<Abstract>With the rise of augmented and virtual reality, new interactive technologies are incorporating immersive user interfaces that leverage gesture and voice recognition in addition to existing controller inputs. However, the state-of-the-art interfaces are quite rudimentary and not widely accessible for the user. Such interfaces require significant amount of sensors, extensive calibration, and/or high latency in the gestural commands. LUI (Large User Interface) is a scalable, multimodal interface that uses a framework of nondiscrete, free-handed gestures and voice to control modular applications with a single stereo-camera and voice assistant. The gestures and voice input are mapped to web UI elements to provide a highly-responsive and accessible user experience. The menu screen consists of an extendable list of applications, currently including photos, YouTube, etc, which are navigated through the input framework. This interface can be deployed on an AR or VR system, heads-up displays for autonomous vehicles, and everyday large displays.</Abstract>
<Access xmlns="http://purl.org/coar/access_right"
>
</Access>
</Publication>