Sublimate: State-Changing Virtual and Physical Rendering to Augment Interaction with Shape Displays
Author(s)Leithinger, Daniel; Olwal, Alex; Luescher, Samuel; Lee, Jinha; Ishii, Hiroshi; Follmer, Sean Weston; Hogge, Akimitsu G.; ... Show more Show less
MetadataShow full item record
Recent research in 3D user interfaces pushes towards immersive graphics and actuated shape displays. Our work explores the hybrid of these directions, and we introduce sublimation and deposition, as metaphors for the transitions between physical and virtual states. We discuss how digital models, handles and controls can be interacted with as virtual 3D graphics or dynamic physical shapes, and how user interfaces can rapidly and fluidly switch between those representations. To explore this space, we developed two systems that integrate actuated shape displays and augmented reality (AR) for co-located physical shapes and 3D graphics. Our spatial optical see-through display provides a single user with head-tracked stereoscopic augmentation, whereas our handheld devices enable multi-user interaction through video seethrough AR. We describe interaction techniques and applications that explore 3D interaction for these new modalities. We conclude by discussing the results from a user study that show how freehand interaction with physical shape displays and co-located graphics can outperform wand-based interaction with virtual 3D graphics.
DepartmentMassachusetts Institute of Technology. Center for Transportation & Logistics; Massachusetts Institute of Technology. Media Laboratory; Massachusetts Institute of Technology. School of Engineering; Program in Media Arts and Sciences (Massachusetts Institute of Technology)
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems - CHI '13
Association for Computing Machinery (ACM)
Daniel Leithinger, Sean Follmer, Alex Olwal, Samuel Luescher, Akimitsu Hogge, Jinha Lee, and Hiroshi Ishii. 2013. Sublimate: state-changing virtual and physical rendering to augment interaction with shape displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 1441-1450.
Author's final manuscript