Deep Closest Point: Learning Representations for Point Cloud Registration
Name
1905.03304.pdf
Description
Submitted version
Size
4.6 MB
Format
Adobe PDF
Checksum (MD5)
13f97df614ac7b02d50914be7c097324
Author(s) •
Wang, Yue
Solomon, Justin
Date Issued
October 2019
Journal
Proceedings of the IEEE International Conference on Computer Vision
Publisher
IEEE
Citation
Wang, Yue and Solomon, Justin. 2019. "Deep Closest Point: Learning Representations for Point Cloud Registration." Proceedings of the IEEE International Conference on Computer Vision, 2019-October.
Version
Original manuscript
Abstract
© 2019 IEEE. Point cloud registration is a key problem for computer vision applied to robotics, medical imaging, and other applications. This problem involves finding a rigid transformation from one point cloud into another so that they align. Iterative Closest Point (ICP) and its variants provide simple and easily-implemented iterative methods for this task, but these algorithms can converge to spurious local optima. To address local optima and other difficulties in the ICP pipeline, we propose a learning-based method, titled Deep Closest Point (DCP), inspired by recent techniques in computer vision and natural language processing. Our model consists of three parts: A point cloud embedding network, an attention-based module combined with a pointer generation layer to approximate combinatorial matching, and a differentiable singular value decomposition (SVD) layer to extract the final rigid transformation. We train our model end-to-end on the ModelNet40 dataset and show in several settings that it performs better than ICP, its variants (e.g., Go-ICP, FGR), and the recently-proposed learning-based method PointNetLK. Beyond providing a state-of-the-art registration technique, we evaluate the suitability of our learned features transferred to unseen objects. We also provide preliminary analysis of our learned model to help understand whether domain-specific and/or global features facilitate rigid registration.
MIT Department
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory
Terms of Use
Creative Commons Attribution-Noncommercial-Share Alike
Persistent DSpace Link
DOI of Published Version
https://doi.org/10.1109/ICCV.2019.00362