Learning-in-the-loop optimization: End-to-end control and co-design of soft robots through learned deep latent representations
Author(s)
Spielberg, Andrew; Zhao, Allan; Du, Tao; Hu, Yuanming; Rus, Daniela L; Matusik, Wojciech; ... Show more Show less
DownloadPublished version (10.14Mb)
Publisher Policy
Publisher Policy
Article is made available in accordance with the publisher's policy and may be subject to US copyright law. Please refer to the publisher's site for terms of use.
Terms of use
Metadata
Show full item recordAbstract
Soft robots have continuum solid bodies that can deform in an infinite number of ways. Controlling soft robots is very challenging as there are no closed form solutions. We present a learning-in-the-loop co-optimization algorithm in which a latent state representation is learned as the robot figures out how to solve the task. Our solution marries hybrid particle-grid-based simulation with deep, variational convolutional autoencoder architectures that can capture salient features of robot dynamics with high efficacy. We demonstrate our dynamics-aware feature learning algorithm on both 2D and 3D soft robots, and show that it is more robust and faster converging than the dynamics-oblivious baseline. We validate the behavior of our algorithm with visualizations of the learned representation.
Date issued
2019Department
Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory; Massachusetts Institute of Technology. Department of Electrical Engineering and Computer ScienceJournal
Advances in Neural Information Processing Systems
Citation
Spielberg, Andrew et al. "Learning-in-the-loop optimization: End-to-end control and co-design of soft robots through learned deep latent representations." Advances in Neural Information Processing Systems 32 (2019). © 2019 Neural information processing systems foundation. All rights reserved.
Version: Final published version
ISSN
1049-5258