PerForm : deformable interface for dynamic representation of sound through meaningful shapes

Abstract

User Interfaces rely on the mediation between control and representation. The model of Tangible User Interfaces (TUI) proposes to blur the barrier between the two, but while in many cases the output can be literally materialized, direct representation is harder to achieve when information is immaterial or complex. Meaningful mental connections from perceptual qualities to high-level ideas make it possible to use visual representations for actions and immaterial concepts, which can provide mappings for dynamic input. Focusing on associations between shapes and sounds, this thesis investigates the potential for using non-iconic shape metaphors to enable interactions in which digital information is controlled by a perceptual language of form. The idea is demonstrated through a deformable device whose physical form can be redefined by hand manipulation. Each new form materializes ideas and sensations produced by sound, so the input device becomes, in itself, a physical representation of the output.