Distributed Learning for Planning Under Uncertainty Problems with Heterogeneous Teams
Name
10846_2013_9980_ReferencePDF.pdf
Size
3.81 MB
Format
Adobe PDF
Checksum (MD5)
84d449875d2c7e7f0ab27fe8610969f3
Author(s)
Ure, N. Kemal
Chowdhary, Girish
Chen, Yu Fan
How, Jonathan P.
Vian, John
Date Issued
November 2013
Journal
Journal of Intelligent & Robotic Systems
Publisher
Springer Netherlands
Citation
Ure, N. Kemal, Girish Chowdhary, Yu Fan Chen, Jonathan P. How, and John Vian. “Distributed Learning for Planning Under Uncertainty Problems with Heterogeneous Teams.” J Intell Robot Syst 74, no. 1–2 (November 19, 2013): 529–544.
Version
Author's final manuscript
Abstract
This paper considers the problem of multiagent sequential decision making under uncertainty and incomplete knowledge of the state transition model. A distributed learning framework, where each agent learns an individual model and shares the results with the team, is proposed. The challenges associated with this approach include choosing the model representation for each agent and how to effectively share these representations under limited communication. A decentralized extension of the model learning scheme based on the Incremental Feature Dependency Discovery (Dec-iFDD) is presented to address the distributed learning problem. The representation selection problem is solved by leveraging iFDD’s property of adjusting the model complexity based on the observed data. The model sharing problem is addressed by having each agent rank the features of their representation based on the model reduction error and broadcast the most relevant features to their teammates. The algorithm is tested on the multi-agent block building and the persistent search and track missions. The results show that the proposed distributed learning scheme is particularly useful in heterogeneous learning setting, where each agent learns significantly different models. We show through large-scale planning under uncertainty simulations and flight experiments with state-dependent actuator and fuel-burn- rate uncertainty that our planning approach can outperform planners that do not account for heterogeneity between agents.
MIT Department
Massachusetts Institute of Technology. Department of Aeronautics and Astronautics
Massachusetts Institute of Technology. Laboratory for Information and Decision Systems
Terms of Use
Creative Commons Attribution-Noncommercial-Share Alike
Persistent DSpace Link
DOI of Published Version
https://doi.org/10.1007/s10846-013-9980-x
