Object schemas for responsive robotic language use
Author(s)Hsiao, Kai-yuh; Vosoughi, Soroush; Tellex, Stefanie; Kubat, Rony Daniel; Roy, Deb K.
MetadataShow full item record
The use of natural language should be added to a robot system without sacrificing responsiveness to the environment. In this paper, we present a robot that manipulates objects on a tabletop in response to verbal interaction. Reactivity is maintained by using concurrent interaction processes, such as visual trackers and collision detection processes. The interaction processes and their associated data are organized into object schemas, each representing a physical object in the environment, based on the target of each process. The object schemas then serve as discrete structures of coordination between reactivity, planning, and language use, permitting rapid integration of information from multiple sources.
DepartmentProgram in Media Arts and Sciences (Massachusetts Institute of Technology)
Proceedings of the 3rd international conference on Human robot interaction (HRI '08)
Association for Computing Machinery
Hsiao, Kai-yuh, Soroush Vosoughi, Stefanie Tellex, Rony Kubat, and Deb Roy. “Object Schemas for Responsive Robotic Language Use.” Proceedings of the 3rd International Conference on Human Robot Interaction - HRI ’08 (2008), March 12-15, 2008, Amsterdam, the Netherlands, ACM Press, (2008).
Author's final manuscript