Heads-Up Multitasker: Simulating Attention Switching On Optical Head-Mounted Displays
Name
3613904.3642540.pdf
Size
3.08 MB
Format
Adobe PDF
Checksum (MD5)
8d9cdca421e5edc1b5020568a89f3192
Author(s)
Bai, Yunpeng
Ikkala, Aleksi
Oulasvirta, Antti
Zhao, Shengdong
Wang, Lucia J
Yang, Pengzhi
Xu, Peisen
Date Issued
May 11, 2024
Publisher
ACM
Citation
Bai, Yunpeng, Ikkala, Aleksi, Oulasvirta, Antti, Zhao, Shengdong, Wang, Lucia J et al. 2024. "Heads-Up Multitasker: Simulating Attention Switching On Optical Head-Mounted Displays."
Version
Final published version
Abstract
Optical Head-Mounted Displays (OHMDs) allow users to read digital content while walking. A better understanding of how users allocate attention between these two tasks is crucial for improving OHMD interfaces. This paper introduces a computational model for simulating users’ attention switches between reading and walking. We model users’ decision to deploy visual attention as a hierarchical reinforcement learning problem, wherein a supervisory controller optimizes attention allocation while considering both reading activity and walking safety. Our model simulates the control of eye movements and locomotion as an adaptation to the given task priority, design of digital content, and walking speed. The model replicates key multitasking behaviors during OHMD reading while walking, including attention switches, changes in reading and walking speeds, and reading resumptions.
Description
CHI '24: Proceedings of the CHI Conference on Human Factors in Computing Systems May 11–16, 2024, Honolulu, HI, USA
MIT Department
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Terms of Use
Creative Commons Attribution
Persistent DSpace Link
DOI of Published Version
https://doi.org/10.1145/3613904.3642540
