Toward a One-interaction Data-driven Guide: Putting co-Speech Gesture Evidence to Work for Ambiguous Route Instructions
Name
3434074.3447223.pdf
Size
20.83 MB
Format
Adobe PDF
Checksum (MD5)
0bc4d97701e76f2f501e0ac974968745
Author(s)
DePalma, Nicholas
Smith, H
Chernova, Sonia
Hodgins, Jessica
Date Issued
March 8, 2021
Publisher
ACM|Companion of the 2021 ACM/IEEE International Conference on Human-Robot Interaction
Citation
DePalma, Nicholas, Smith, H, Chernova, Sonia and Hodgins, Jessica. 2021. "Toward a One-interaction Data-driven Guide: Putting co-Speech Gesture Evidence to Work for Ambiguous Route Instructions."
Version
Final published version
Abstract
While recent work on gesture synthesis in agent and robot literature has treated gesture as co-speech and thus dependent on verbal utterances, we present evidence that gesture may leverage model context (i.e. the navigational task) and is not solely dependent on verbal utterance. This effect is particularly evident within ambiguous verbal utterances. Decoupling this dependency may allow future systems to synthesize clarifying gestures that clarify the ambiguous verbal utterance while enabling research in better understanding the semantics of the gesture. We bring together evidence from our own experiences in this domain that allow us to see for the first time what kind of end-to-end concerns models need to be developed to synthesize gesture for one-shot interactions while still preserving user outcomes and allowing for ambiguous utterances by the robot. We discuss these issues within the context of "cardinal direction gesture plans" which represent instructions that refer to the actions the human must follow in the future.
Description
HRI ’21 Companion, March 8–11, 2021, Boulder, CO, USA
MIT Department
Massachusetts Institute of Technology. Media Laboratory
Terms of Use
Creative Commons Attribution
Persistent DSpace Link
DOI of Published Version
https://doi.org/10.1145/3434074.3447223
