BiDi screen: a thin, depth-sensing LCD for 3D interaction using light fields
Name
Raskar_Bidi Screen.pdf
Size
8.81 MB
Format
Adobe PDF
Checksum (MD5)
6ef9995134a4a78ff3e72f1b012dfb7e
Author(s)
Hirsch, Matthew Waggener
Lanman, Douglas R.
Holtzman, Henry N.
Raskar, Ramesh
Date Issued
December 2009
Journal
ACM Transactions on Graphics
Publisher
ACM, Inc.
Citation
Hirsch, Matthew et al. “BiDi screen.” ACM Transactions on Graphics 28 (2009): 1. Web. 21 Oct. 2011. © 2011 ACM, Inc.
Version
Author's final manuscript
Abstract
We transform an LCD into a display that supports both 2D multi-touch and unencumbered 3D gestures. Our BiDirectional (BiDi) screen, capable of both image capture and display, is inspired by emerging LCDs that use embedded optical sensors to detect multiple points of contact. Our key contribution is to exploit the spatial light modulation capability of LCDs to allow lensless imaging without interfering with display functionality. We switch between a display mode showing traditional graphics and a capture mode in which the backlight is disabled and the LCD displays a pinhole array or an equivalent tiled-broadband code. A large-format image sensor is placed slightly behind the liquid crystal layer. Together, the image sensor and LCD form a mask-based light field camera, capturing an array of images equivalent to that produced by a camera array spanning the display surface. The recovered multi-view orthographic imagery is used to passively estimate the depth of scene points. Two motivating applications are described: a hybrid touch plus gesture interaction and a light-gun mode for interacting with external light-emitting widgets. We show a working prototype that simulates the image sensor with a camera and diffuser, allowing interaction up to 50 cm in front of a modified 20.1 inch LCD.
MIT Department
Massachusetts Institute of Technology. Media Laboratory
Program in Media Arts and Sciences (Massachusetts Institute of Technology)
Terms of Use
Creative Commons Attribution-Noncommercial-Share Alike 3.0
Persistent DSpace Link
DOI of Published Version
https://doi.org/10.1145/1618452.1618505
