POMCoP: Belief Space Planning for Sidekicks in Cooperative Games
Author(s)Macindoe, Owen; Kaelbling, Leslie P.; Lozano-Perez, Tomas
MetadataShow full item record
We present POMCoP, a system for online planning in collaborative domains that reasons about how its actions will affect its understanding of human intentions, and demonstrate its use in building sidekicks for cooperative games. POMCoP plans in belief space. It explicitly represents its uncertainty about the intentions of its human ally, and plans actions which reveal those intentions or hedge against its uncertainty. This allows POMCoP to reason about the usefulness of incorporating information gathering actions into its plans, such as asking questions, or simply waiting to let humans reveal their intentions. We demonstrate POMCoP by constructing a sidekick for a cooperative pursuit game, and evaluate its effectiveness relative to MDP-based techniques that plan in state space, rather than belief space.
DepartmentMassachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory; Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Proceedings of the 8th Artificial Intelligence and Interactive Digital Entertainment Conference
Association for the Advancement of Artificial Intelligence
Macindoe, Owen, Leslie Pack Kaelbling, and Tomas Lozano-Perez. "POMCoP: Belief Space Planning for Sidekicks in Cooperative Games." 8th Artificial Intelligence and Interactive Digital Entertainment Conference (October 2012).
Author's final manuscript