Shape synthesis : physical object augmentation and actuation for display and interaction on shape changing interfaces

Abstract

Pin based shape displays can not only give physical form to digital information, but they have the inherent ability to accurately move and manipulate objects that are placed on top of them. This document presents ways and ideas that show how a shape display's dynamic shape changing ability can work in unison with physical objects that are placed on top of it. First, we introduce the idea of shape synthesis, which is the physical augmentation of inert physical objects with the dynamic shape to create a seemingly new object. This synthesized object combines the advantages of the inert object's natural affordances with the computational power of dynamic shape change. In so doing, we can substitute for passive objects, complement passive objects and enable easier interactions with a shape display. We then show that a shape display can be used to assemble, disassemble and reassemble structures from simple passive building blocks through stacking, scaffolding and catapulting. Then, we introduce special unpowered kinematic modules that can be driven and sensed through the underlying pins. These modules can translate the vertical pin movement into other degrees of freedom like rotation or horizontal movement. This suggests that a shape display can be regarded as a versatile physical control platform that can drive and control a variety of useful mechanisms and objects.