Recognizing scene viewpoint using panoramic place representation
Author(s)Xiao, Jianxiong; Ehinger, Krista A.; Oliva, Aude; Torralba, Antonio
MetadataShow full item record
We introduce the problem of scene viewpoint recognition, the goal of which is to classify the type of place shown in a photo, and also recognize the observer's viewpoint within that category of place. We construct a database of 360° panoramic images organized into 26 place categories. For each category, our algorithm automatically aligns the panoramas to build a full-view representation of the surrounding place. We also study the symmetry properties and canonical viewpoint of each place category. At test time, given a photo of a scene, the model can recognize the place category, produce a compass-like indication of the observer's most likely viewpoint within that place, and use this information to extrapolate beyond the available view, filling in the probable visual layout that would appear beyond the boundary of the photo.
DepartmentMassachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory; Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition
Institute of Electrical and Electronics Engineers (IEEE)
Xiao, Jianxiong, K. A. Ehinger, A. Oliva, and A. Torralba. “Recognizing Scene Viewpoint Using Panoramic Place Representation.” 2012 IEEE Conference on Computer Vision and Pattern Recognition (June 2012).
Author's final manuscript