Repository logo
Log in(current)
Repository logoMIT Open ScholarshipDSpace@MIT
  1. Home
  2. MIT Open Access Articles
  3. MIT Open Access Articles
  4. Gestures Everywhere: A Multimodal Sensor Fusion and Analysis Framework for Pervasive Displays

Gestures Everywhere: A Multimodal Sensor Fusion and Analysis Framework for Pervasive Displays

Thumbnail Image
Download
Name

Paradiso_Gestures everywhere.pdf

Size

3.74 MB

Format

Adobe PDF

Checksum (MD5)

1e00bae2a324c5661d4915defee08ae0

Author(s)
Gillian, Nicholas Edward
•
Pfenninger, Sara
•
Paradiso, Joseph A.
•
Russell, Spencer Franklin
Date Issued
June 2014
Journal
Proceedings of The International Symposium on Pervasive Displays (PerDis '14)
Publisher
Association for Computing Machinery (ACM)
Citation
Nicholas Gillian, Sara Pfenninger, Spencer Russell, and Joseph A. Paradiso. 2014. Gestures Everywhere: A Multimodal Sensor Fusion and Analysis Framework for Pervasive Displays. In Proceedings of The International Symposium on Pervasive Displays (PerDis '14), Sven Gehring (Ed.). ACM, New York, NY, USA, Pages 98, 6 pages.
Version
Author's final manuscript
Abstract
Gestures Everywhere is a dynamic framework for multimodal sensor fusion, pervasive analytics and gesture recognition. Our framework aggregates the real-time data from approximately 100 sensors that include RFID readers, depth cameras and RGB cameras distributed across 30 interactive displays that are located in key public areas of the MIT Media Lab. Gestures Everywhere fuses the multimodal sensor data using radial basis function particle filters and performs real-time analysis on the aggregated data. This includes key spatio-temporal properties such as presence, location and identity; in addition to higher-level analysis including social clustering and gesture recognition. We describe the algorithms and architecture of our system and discuss the lessons learned from the systems deployment.
MIT Department
Massachusetts Institute of Technology. Media Laboratory
Massachusetts Institute of Technology. Responsive Environments Group
Program in Media Arts and Sciences (Massachusetts Institute of Technology)
Terms of Use
Creative Commons Attribution-Noncommercial-Share Alike
http://creativecommons.org/licenses/by-nc-sa/4.0/
Persistent DSpace Link
http://hdl.handle.net/1721.1/92444
DOI of Published Version
https://doi.org/10.1145/2611009.2611032
Repository logo
PrivacyPermissionsAccessibilityContact us
Repository logo
Notify us about copyright concerns.