Gestures Everywhere: A Multimodal Sensor Fusion and Analysis Framework for Pervasive Displays
Name
Paradiso_Gestures everywhere.pdf
Size
3.74 MB
Format
Adobe PDF
Checksum (MD5)
1e00bae2a324c5661d4915defee08ae0
Author(s)
Gillian, Nicholas Edward
Pfenninger, Sara
Paradiso, Joseph A.
Russell, Spencer Franklin
Date Issued
June 2014
Journal
Proceedings of The International Symposium on Pervasive Displays (PerDis '14)
Publisher
Association for Computing Machinery (ACM)
Citation
Nicholas Gillian, Sara Pfenninger, Spencer Russell, and Joseph A. Paradiso. 2014. Gestures Everywhere: A Multimodal Sensor Fusion and Analysis Framework for Pervasive Displays. In Proceedings of The International Symposium on Pervasive Displays (PerDis '14), Sven Gehring (Ed.). ACM, New York, NY, USA, Pages 98, 6 pages.
Version
Author's final manuscript
Abstract
Gestures Everywhere is a dynamic framework for multimodal sensor fusion, pervasive analytics and gesture recognition. Our framework aggregates the real-time data from approximately 100 sensors that include RFID readers, depth cameras and RGB cameras distributed across 30 interactive displays that are located in key public areas of the MIT Media Lab. Gestures Everywhere fuses the multimodal sensor data using radial basis function particle filters and performs real-time analysis on the aggregated data. This includes key spatio-temporal properties such as presence, location and identity; in addition to higher-level analysis including social clustering and gesture recognition. We describe the algorithms and architecture of our system and discuss the lessons learned from the systems deployment.
MIT Department
Massachusetts Institute of Technology. Media Laboratory
Massachusetts Institute of Technology. Responsive Environments Group
Program in Media Arts and Sciences (Massachusetts Institute of Technology)
Terms of Use
Creative Commons Attribution-Noncommercial-Share Alike
Persistent DSpace Link
DOI of Published Version
https://doi.org/10.1145/2611009.2611032
