Air-Combat Strategy Using Approximate Dynamic Programming
Name
Roy_Air Combat.pdf
Size
1.48 MB
Format
Adobe PDF
Checksum (MD5)
d57fab1561b76ac649ab69c2a54ee0a3
Author(s) • • • •
McGrew, James S.
How, Jonathan P.
Bush, Lawrence
Williams, Brian Charles
Roy, Nicholas
Date Issued
September 2010
Journal
Journal of Guidance, Control, and Dynamics
Publisher
American Institute of Aeronautics and Astronautics
Citation
McGrew, James S. et al. “Air-Combat Strategy Using Approximate Dynamic Programming.” Journal of Guidance, Control, and Dynamics 33 (2010): 1641-1654.
Version
Author's final manuscript
Abstract
Unmanned Aircraft Systems (UAS) have the potential to perform many
of the dangerous missions currently own by manned aircraft. Yet, the
complexity of some tasks, such as air combat, have precluded UAS from
successfully carrying out these missions autonomously. This paper presents
a formulation of a level flight, fixed velocity, one-on-one air combat maneuvering problem and an approximate dynamic programming (ADP) approach for computing an efficient approximation of the optimal policy. In the version of the problem formulation considered, the aircraft learning the
optimal policy is given a slight performance advantage. This ADP approach
provides a fast response to a rapidly changing tactical situation, long planning horizons, and good performance without explicit coding of air combat tactics. The method's success is due to extensive feature development, reward shaping and trajectory sampling. An accompanying fast and e ffective rollout-based policy extraction method is used to accomplish on-line implementation. Simulation results are provided that demonstrate the robustness of the method against an opponent beginning from both off ensive and defensive situations. Flight results are also presented using micro-UAS own at MIT's Real-time indoor Autonomous Vehicle test ENvironment
(RAVEN).
MIT Department
Massachusetts Institute of Technology. Aerospace Controls Laboratory
Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory
Massachusetts Institute of Technology. Department of Aeronautics and Astronautics
Terms of Use
Creative Commons Attribution-Noncommercial-Share Alike 3.0
Persistent DSpace Link
DOI of Published Version
https://doi.org/10.2514/1.46815