A Mixture of Manhattan Frames: Beyond the Manhattan World
Name
Leonard_A mixture.pdf
Size
8.32 MB
Format
Adobe PDF
Checksum (MD5)
f13759fef72f276bf7be62bbd2c9c39c
Author(s) • • • •
Straub, Julian
Rosman, Guy
Freifeld, Oren
Leonard, John Joseph
Fisher, John W., III
Date Issued
June 2014
Journal
Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Citation
Straub, Julian, Guy Rosman, Oren Freifeld, John J. Leonard, and John W. Fisher. “A Mixture of Manhattan Frames: Beyond the Manhattan World.” 2014 IEEE Conference on Computer Vision and Pattern Recognition (June 2014).
Version
Author's final manuscript
Abstract
Objects and structures within man-made environments typically exhibit a high degree of organization in the form of orthogonal and parallel planes. Traditional approaches to scene representation exploit this phenomenon via the somewhat restrictive assumption that every plane is perpendicular to one of the axes of a single coordinate system. Known as the Manhattan-World model, this assumption is widely used in computer vision and robotics. The complexity of many real-world scenes, however, necessitates a more flexible model. We propose a novel probabilistic model that describes the world as a mixture of Manhattan frames: each frame defines a different orthogonal coordinate system. This results in a more expressive model that still exploits the orthogonality constraints. We propose an adaptive Markov-Chain Monte-Carlo sampling algorithm with Metropolis-Hastings split/merge moves that utilizes the geometry of the unit sphere. We demonstrate the versatility of our Mixture-of-Manhattan-Frames model by describing complex scenes using depth images of indoor scenes as well as aerial-LiDAR measurements of an urban center. Additionally, we show that the model lends itself to focal-length calibration of depth cameras and to plane segmentation.
MIT Department
Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Massachusetts Institute of Technology. Department of Mechanical Engineering
Terms of Use
Creative Commons Attribution-Noncommercial-Share Alike
Persistent DSpace Link
DOI of Published Version
https://doi.org/10.1109/CVPR.2014.488