deForm: An interactive malleable surface for capturing 2.5D arbitrary objects, tools and touch
Name
Ishii_deForm an interactive.pdf
Size
24.53 MB
Format
Adobe PDF
Checksum (MD5)
9a877246694b9597fcf424111136d4df
Author(s)
Ishii, Hiroshi
Follmer, Sean Weston
Johnson, Micah K.
Adelson, Edward H
Date Issued
October 2011
Journal
Proceedings of the 24th annual ACM symposium on User interface software and technology (UIST '11)
Publisher
Association for Computing Machinery (ACM)
Citation
Sean Follmer, Micah Johnson, Edward Adelson, and Hiroshi Ishii. 2011. deForm: an interactive malleable surface for capturing 2.5D arbitrary objects, tools and touch. In Proceedings of the 24th annual ACM symposium on User interface software and technology (UIST '11). ACM, New York, NY, USA, 527-536
Version
Author's final manuscript
Abstract
We introduce a novel input device, deForm, that supports 2.5D touch gestures, tangible tools, and arbitrary objects through real-time structured light scanning of a malleable surface of interaction. DeForm captures high-resolution surface deformations and 2D grey-scale textures of a gel surface through a three-phase structured light 3D scanner. This technique can be combined with IR projection to allow for invisible capture, providing the opportunity for co-located visual feedback on the deformable surface. We describe methods for tracking fingers, whole hand gestures, and arbitrary tangible tools. We outline a method for physically encoding fiducial marker information in the height map of tangible tools. In addition, we describe a novel method for distinguishing between human touch and tangible tools, through capacitive sensing on top of the input surface. Finally we motivate our device through a number of sample applications.
MIT Department
Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory
Massachusetts Institute of Technology. Department of Brain and Cognitive Sciences
Massachusetts Institute of Technology. Media Laboratory
Program in Media Arts and Sciences (Massachusetts Institute of Technology)
Terms of Use
Creative Commons Attribution-Noncommercial-Share Alike 3.0
Persistent DSpace Link
DOI of Published Version
https://doi.org/10.1145/2047196.2047265
