Planning for decentralized control of multiple robots under uncertainty
Author(s)Amato, Christopher; Cruz, Gabriel; Maynor, Christopher A.; How, Jonathan P.; Kaelbling, Leslie P.; Konidaris, George D.; ... Show more Show less
MetadataShow full item record
This paper presents a probabilistic framework for synthesizing control policies for general multi-robot systems that is based on decentralized partially observable Markov decision processes (Dec-POMDPs). Dec-POMDPs are a general model of decision-making where a team of agents must cooperate to optimize a shared objective in the presence of uncertainty. Dec-POMDPs also consider communication limitations, so execution is decentralized. While Dec-POMDPs are typically intractable to solve for real-world problems, recent research on the use of macro-actions in Dec-POMDPs has significantly increased the size of problem that can be practically solved. We show that, in contrast to most existing methods that are specialized to a particular problem class, our approach can synthesize control policies that exploit any opportunities for coordination that are present in the problem, while balancing uncertainty, sensor information, and information about other agents. We use three variants of a warehouse task to show that a single planner of this type can generate cooperative behavior using task allocation, direct communication, and signaling, as appropriate. This demonstrates that our algorithmic framework can automatically optimize control and communication policies for complex multi-robot systems.
DepartmentMassachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory; Massachusetts Institute of Technology. Department of Aeronautics and Astronautics; Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science; Massachusetts Institute of Technology. Laboratory for Information and Decision Systems
Proceedings of the 2015 IEEE International Conference on Robotics and Automation (ICRA)
Institute of Electrical and Electronics Engineers (IEEE)
Amato, Christopher, George Konidaris, Gabriel Cruz, Christopher A. Maynor, Jonathan P. How, and Leslie P. Kaelbling. “Planning for Decentralized Control of Multiple Robots Under Uncertainty.” 2015 IEEE International Conference on Robotics and Automation (ICRA) (May 2015).