Heads-Up Multitasker: Simulating Attention Switching On Optical Head-Mounted Displays
Author(s)
Bai, Yunpeng; Ikkala, Aleksi; Oulasvirta, Antti; Zhao, Shengdong; Wang, Lucia J; Yang, Pengzhi; Xu, Peisen; ... Show more Show less
Download3613904.3642540.pdf (3.082Mb)
Publisher with Creative Commons License
Publisher with Creative Commons License
Creative Commons Attribution
Terms of use
Metadata
Show full item recordAbstract
Optical Head-Mounted Displays (OHMDs) allow users to read digital content while walking. A better understanding of how users allocate attention between these two tasks is crucial for improving OHMD interfaces. This paper introduces a computational model for simulating users’ attention switches between reading and walking. We model users’ decision to deploy visual attention as a hierarchical reinforcement learning problem, wherein a supervisory controller optimizes attention allocation while considering both reading activity and walking safety. Our model simulates the control of eye movements and locomotion as an adaptation to the given task priority, design of digital content, and walking speed. The model replicates key multitasking behaviors during OHMD reading while walking, including attention switches, changes in reading and walking speeds, and reading resumptions.
Description
CHI '24: Proceedings of the CHI Conference on Human Factors in Computing Systems May 11–16, 2024, Honolulu, HI, USA
Date issued
2024-05-11Department
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer SciencePublisher
ACM
Citation
Bai, Yunpeng, Ikkala, Aleksi, Oulasvirta, Antti, Zhao, Shengdong, Wang, Lucia J et al. 2024. "Heads-Up Multitasker: Simulating Attention Switching On Optical Head-Mounted Displays."
Version: Final published version
ISBN
979-8-4007-0330-0
Collections
The following license files are associated with this item: