3D exploitation of large urban photo archives
Author(s)Snavely, Noah; Anderson, Ross W.; Cho, Peter L.
MetadataShow full item record
Recent work in computer vision has demonstrated the potential to automatically recover camera and scene geometry from large collections of uncooperatively-collected photos. At the same time, aerial ladar and Geographic Information System (GIS) data are becoming more readily accessible. In this paper, we present a system for fusing these data sources in order to transfer 3D and GIS information into outdoor urban imagery. Applying this system to 1000+ pictures shot of the lower Manhattan skyline and the Statue of Liberty, we present two proof-of-concept examples of geometry-based photo enhancement which are difficult to perform via conventional image processing: feature annotation and image-based querying. In these examples, high-level knowledge projects from 3D world-space into georegistered 2D image planes and/or propagates between different photos. Such automatic capabilities lay the groundwork for future real-time labeling of imagery shot in complex city environments by mobile smart phones.
Proceedings of SPIE--the International Society for Optical Engineering; v. 7697
Peter Cho, Noah Snavely, and Ross Anderson (2010). 3D exploitation of large urban photo archives. Proc. SPIE 7697: 769714/1-8. ©2010 COPYRIGHT SPIE--The International Society for Optical Engineering.
Final published version
computer vision, 3D reconstruction, ladar georegistration, knowledge transfer