PANDALens: Towards AI-Assisted In-Context Writing on OHMD During Travels
Name
3613904.3642320.pdf
Size
7.68 MB
Format
Adobe PDF
Checksum (MD5)
e9ea8a98e6a3a95565f0523e53e4e0d9
Author(s)
Cai, Runze
Janaka, Nuwan
Chen, Yang
Wang, Lucia
Zhao, Shengdong
Liu, Can
Date Issued
May 11, 2024
Publisher
ACM
Citation
Cai, Runze, Janaka, Nuwan, Chen, Yang, Wang, Lucia, Zhao, Shengdong et al. 2024. "PANDALens: Towards AI-Assisted In-Context Writing on OHMD During Travels."
Version
Final published version
Abstract
While effective for recording and sharing experiences, traditional in-context writing tools are relatively passive and unintelligent, serving more like instruments rather than companions. This reduces primary task (e.g., travel) enjoyment and hinders high-quality writing. Through formative study and iterative development, we introduce PANDALens, a Proactive AI Narrative Documentation Assistant built on an Optical See-Through Head Mounted Display that supports personalized documentation in everyday activities. PANDALens observes multimodal contextual information from user behaviors and environment to confirm interests and elicit contemplation, and employs Large Language Models to transform such multimodal information into coherent narratives with significantly reduced user effort. A real-world travel scenario comparing PANDALens with a smartphone alternative confirmed its effectiveness in improving writing quality and travel enjoyment while minimizing user effort. Accordingly, we propose design guidelines for AI-assisted in-context writing, highlighting the potential of transforming them from tools to intelligent companions.
Terms of Use
Creative Commons Attribution
Persistent DSpace Link
DOI of Published Version
https://doi.org/10.1145/3613904.3642320
