Multimodal Environmental Interfaces : discrete and continuous changes of form, light, and color using natural modes of expression

Abstract

In this thesis, I defined and implemented a framework for design and evaluation of Multinodal Environmental Interfaces. Multimodal Environmental Interfaces allow users to control form, light, and color using natural modes of expression. The framework is defined by categorizing possible changes as discrete or continuous. Discrete and continuous properties of form, light, and color can be controlled by speech, gestures and facial expressions. In order to evaluate advantages and disadvantages of each of the modalities, I designed and conducted a series of experiments. I disproved my hypothesis that whereas discrete changes are easier to control with language, continuous changes are easier to control with gestures and facial expressions through a series of interactive prototypes. I proved my hypothesis that the perception of whether a gesture or a speech command feels intuitive is consistent among the majority of users.