Decentralized Control of Partially Observable Markov Decision Processes Using Belief Space Macro-Actions
Name
ICRA15_2269_FI.pdf
Size
332.64 KB
Format
Adobe PDF
Checksum (MD5)
f0b721b659ef7a61ddde44dc1bbc1d88
Author(s)
Omidshafiei, Shayegan
Agha-mohammadi, Ali-akbar
Amato, Christopher
How, Jonathan P.
Date Issued
May 2015
Journal
Proceedings of the 2015 IEEE International Conference on Robotics and Automation
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Citation
Omidshafiei, Shayegan, Ali-akbar Agha-mohammadi, Christopher Amato, and Jonathan P. How. "Decentralized Control of Partially Observable Markov Decision Processes Using Belief Space Macro-Actions." 2015 IEEE International Conference on Robotics and Automation (May 2015).
Version
Author's final manuscript
Abstract
he focus of this paper is on solving multi-robot planning problems in continuous spaces with partial observability. Decentralized Partially Observable Markov Decision Processes (Dec-POMDPs) are general models for multi-robot coordination problems, but representing and solving Dec-POMDPs is often intractable for large problems. To allow for a high-level representation that is natural for multi-robot problems and scalable to large discrete and continuous problems, this paper extends the Dec-POMDP model to the Decentralized Partially Observable Semi-Markov Decision Process (Dec-POSMDP). The Dec-POSMDP formulation allows asynchronous decision-making by the robots, which is crucial in multi-robot domains. We also present an algorithm for solving this Dec-POSMDP which is much more scalable than previous methods since it can incorporate closed-loop belief space macro-actions in planning. These macro-actions are automatically constructed to produce robust solutions. The proposed method's performance is evaluated on a complex multi-robot package delivery problem under uncertainty, showing that our approach can naturally represent multi-robot problems and provide high-quality solutions for large-scale problems.
MIT Department
Massachusetts Institute of Technology. Department of Aeronautics and Astronautics
Massachusetts Institute of Technology. Laboratory for Information and Decision Systems
Terms of Use
Creative Commons Attribution-Noncommercial-Share Alike
Persistent DSpace Link
DOI of Published Version
https://ras.papercept.net/conferences/conferences/ICRA15/program/ICRA15_ContentListWeb_4.html#frp2t1_05
