Human-machine collaborative optimization via apprenticeship scheduling
Author(s)Gombolay, Matthew C.; Jensen, Reed E.; Stigile, Jessica L.; Golen, Toni; Shah, Neel; Son, Sung-Hyun; Shah, Julie A; ... Show more Show less
MetadataShow full item record
Coordinating agents to complete a set of tasks with intercoupled temporal and resource constraints is computationally challenging, yet human domain experts can solve these difficult scheduling problems using paradigms learned through years of apprenticeship. A process for manually codifying this domain knowledge within a computational framework is necessary to scale beyond the "single-expert, single-trainee" apprenticeship model. However, human domain experts often have difficulty describing their decision-making processes. We propose a new approach for capturing this decision-making process through counterfactual reasoning in pairwise comparisons. Our approach is model-free and does not require iterating through the state space. We demonstrate that this approach accurately learns multifaceted heuristics on a synthetic and real world data sets. We also demonstrate that policies learned from human scheduling demonstration via apprenticeship learning can substantially improve the efficiency of schedule optimization. We employ this human-machine collaborative optimization technique on a variant of the weapon-to-target assignment problem. We demonstrate that this technique generates optimal solutions up to 9.5 times faster than a state-of-the-art optimization algorithm.
Journal of Artificial Intelligence Research
AI Access Foundation
Gombolay, Matthew, et al., "Human-machine collaborative optimization via apprenticeship scheduling." Journal of Artificial Intelligence Research 63 (Sept. 2018): p. 1-49 doi 10.1613/JAIR.1.11233 ©2018 Author(s)
Author's final manuscript