Director: A User Interface Designed for Robot Operation with Shared Autonomy
Author(s)Marion, Pat; Fallon, Maurice; Deits, Robin Lloyd Henderson; Valenzuela, Andres Klee; Perez D'Arpino, Claudia; Izatt, Gregory R.; Manuelli, Lucas; Antone, Matthew; Dai, Hongkai; Koolen, Twan; Carter, John; Kuindersma, Scott; Tedrake, Russell L; ... Show more Show less
MetadataShow full item record
Operating a high degree of freedom mobile manipulator, such as a humanoid, in a field scenario requires constant situational awareness, capable perception modules, and effective mechanisms for interactive motion planning and control. A well-designed operator interface presents the operator with enough context to quickly carry out a mission and the flexibility to handle unforeseen operating scenarios robustly. By contrast, an unintuitive user interface can increase the risk of catastrophic operator error by overwhelming the user with unnecessary information. With these principles in mind, we present the philosophy and design decisions behind Director—the open-source user interface developed by Team MIT to pilot the Atlas robot in the DARPA Robotics Challenge (DRC). At the heart of Director is an integrated task execution system that specifies sequences of actions needed to achieve a substantive task, such as drilling a wall or climbing a staircase. These task sequences, developed a priori, make online queries to automated perception and planning algorithms with outputs that can be reviewed by the operator and executed by our whole-body controller. Our use of Director at the DRC resulted in efficient high-level task operation while being fully competitive with approaches focusing on teleoperation by highly trained operators. We discuss the primary interface elements that comprise Director, and we provide an analysis of its successful use at the DRC.
DepartmentMassachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory
Journal of Field Robotics
Wiley Periodicals, Inc.
Marion, P. et al. "Director: A User Interface Designed for Robot Operation with Shared Autonomy." Journal of Field Robotics, 34, 2 (March 2017): 262-280 © 2016 Wiley Periodicals, Inc.
Author's final manuscript
Control and Systems Engineering, Computer Science Applications