UAV Cooperative Control with Stochastic Risk Models
Author(s)
Geramifard, Alborz; Redding, Joshua; Roy, Nicholas; How, Jonathan P.
DownloadHow_UAV cooperative.pdf (582.3Kb)
OPEN_ACCESS_POLICY
Open Access Policy
Creative Commons Attribution-Noncommercial-Share Alike
Terms of use
Metadata
Show full item recordAbstract
Risk and reward are fundamental concepts in the cooperative control of unmanned systems. This paper focuses on a constructive relationship between a cooperative planner and a learner in order to mitigate the learning risk while boosting the asymptotic performance and safety of agent behavior. Our framework is an instance of the intelligent cooperative control architecture (iCCA) where a learner (Natural actor-critic, Sarsa) initially follows a “safe” policy generated by a cooperative planner (consensus-based bundle algorithm). The learner incrementally improves this baseline policy through interaction, while avoiding behaviors believed to be “risky”. This paper extends previous work toward the coupling of learning and cooperative control strategies in real-time stochastic domains in two ways: (1) the risk analysis module supports stochastic risk models, and (2) learning schemes that do not store the policy as a separate entity are integrated with the cooperative planner extending the applicability of iCCA framework. The performance of the resulting approaches are demonstrated through simulation of limited fuel UAVs in a stochastic task assignment problem. Results show an 8% reduction in risk, while improving the performance up to 30%.
Date issued
2011-06Department
Massachusetts Institute of Technology. Aerospace Controls Laboratory; Massachusetts Institute of Technology. Laboratory for Information and Decision SystemsJournal
Proceedings of the 2011 American Control Conference
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Citation
Geramifard, Alborz et al. "UAV Cooperative Control with Stochastic Risk Models." IEEE American Control Conference, 2011.
Version: Author's final manuscript
ISBN
978-1-4577-0081-1