Metrically-Scaled Monocular SLAM using Learned Scale Factors
Name
greene_icra20.pdf
Description
Accepted version
Size
1.37 MB
Format
Adobe PDF
Checksum (MD5)
b0b6c65fe512b8abd250bf93f7f082b2
Author(s)
Greene, W. Nicholas (William Nicholas)
Roy, Nicholas
Date Issued
September 2020
Journal
Proceedings - IEEE International Conference on Robotics and Automation
Publisher
IEEE
Citation
Greene, W. Nicholas (William Nicholas) and Roy, Nicholas. 2020. "Metrically-Scaled Monocular SLAM using Learned Scale Factors." Proceedings - IEEE International Conference on Robotics and Automation.
Version
Author's final manuscript
Abstract
© 2020 IEEE. We propose an efficient method for monocular simultaneous localization and mapping (SLAM) that is capable of estimating metrically-scaled motion without additional sensors or hardware acceleration by integrating metric depth predictions from a neural network into a geometric SLAM factor graph. Unlike learned end-to-end SLAM systems, ours does not ignore the relative geometry directly observable in the images. Unlike existing learned depth estimation approaches, ours leverages the insight that when used to estimate scale, learned depth predictions need only be coarse in image space. This allows us to shrink our network to the point that performing inference on a standard CPU becomes computationally tractable.We make several improvements to our network architecture and training procedure to address the lack of depth observability when using coarse images, which allows us to estimate spatially coarse, but depth-accurate predictions in only 30 ms per frame without GPU acceleration. At runtime we incorporate the learned metric data as unary scale factors in a Sim(3) pose graph. Our method is able to generate accurate, scaled poses without additional sensors, hardware accelerators, or special maneuvers and does not ignore or corrupt the observable epipolar geometry. We show compelling results on the KITTI benchmark dataset in addition to real-world experiments with a handheld camera.
MIT Department
Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory
Terms of Use
Creative Commons Attribution-Noncommercial-Share Alike
Persistent DSpace Link
DOI of Published Version
https://doi.org/10.1109/ICRA40945.2020.9196900
