ViObject: Harness Passive Vibrations for Daily Object Recognition with Commodity Smartwatches
Name
3643547.pdf
Size
14.17 MB
Format
Adobe PDF
Checksum (MD5)
49eceb04fc4ba9e6db4e25dcabde39d4
Author(s)
Chen, Wenqiang
Lin, Shupei
Peng, Zhencan
Parizi, Farshid Salemi
Heo, Seongkook
Patel, Shwetak
Matusik, Wojciech
Zhao, Wei
Stankovic, John
Date Issued
March 6, 2024
Journal
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
Publisher
ACM
Citation
Wenqiang Chen , Shupei Lin , Zhencan Peng , Farshid Salemi Parizi , Seongkook Heo , Shwetak Patel , Wojciech
Matusik , Wei Zhao , and John Stankovic . 2024. ViObject: Harness Passive Vibrations for Daily Object Recognition
with Commodity Smartwatches. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. Article ( 2024), 26 pages.
Version
Final published version
Abstract
Knowing the object grabbed by a hand can offer essential contextual information for interaction between the human and the physical world. This paper presents a novel system, ViObject, for passive object recognition that uses accelerometer and gyroscope sensor data from commodity smartwatches to identify untagged everyday objects. The system relies on the vibrations caused by grabbing objects and does not require additional hardware or human effort. ViObject's ability to recognize objects passively can have important implications for a wide range of applications, from smart home automation to healthcare and assistive technologies. In this paper, we present the design and implementation of ViObject, to address challenges such as motion interference, different object-touching positions, different grasp speeds/pressure, and model customization to new users and new objects. We evaluate the system's performance using a dataset of 20 objects from 20 participants and show that ViObject achieves an average accuracy of 86.4%. We also customize models for new users and new objects, achieving an average accuracy of 90.1%. Overall, ViObject demonstrates a novel technology concept of passive object recognition using commodity smartwatches and opens up new avenues for research and innovation in this area.
Subjects
Computer Networks and Communications
Hardware and Architecture
Human-Computer Interaction
MIT Department
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory
Terms of Use
Article is made available in accordance with the publisher's policy and may be subject to US copyright law. Please refer to the publisher's site for terms of use.
Persistent DSpace Link
DOI of Published Version
https://doi.org/10.1145/3643547
