SUN Database: Exploring a Large Collection of Scene Categories
Name
11263_2014_748_ReferencePDF.pdf
Size
90.17 MB
Format
Adobe PDF
Checksum (MD5)
6d820b1ef5c03dcd3fabce03684e9548
Author(s)
Xiao, Jianxiong
Ehinger, Krista A.
Hays, James
Torralba, Antonio
Oliva, Aude
Date Issued
August 2014
Journal
International Journal of Computer Vision
Publisher
Springer US
Citation
Xiao, Jianxiong et al. “SUN Database: Exploring a Large Collection of Scene Categories.” International Journal of Computer Vision 119.1 (2016): 3–22.
Version
Author's final manuscript
Abstract
Progress in scene understanding requires reasoning about the rich and diverse visual environments that make up our daily experience. To this end, we propose the Scene Understanding database, a nearly exhaustive collection of scenes categorized at the same level of specificity as human discourse. The database contains 908 distinct scene categories and 131,072 images. Given this data with both scene and object labels available, we perform in-depth analysis of co-occurrence statistics and the contextual relationship. To better understand this large scale taxonomy of scene categories, we perform two human experiments: we quantify human scene recognition accuracy, and we measure how typical each image is of its assigned scene category. Next, we perform computational experiments: scene recognition with global image features, indoor versus outdoor classification, and “scene detection,” in which we relax the assumption that one image depicts only one scene category. Finally, we relate human experiments to machine performance and explore the relationship between human and machine recognition errors and the relationship between image “typicality” and machine recognition accuracy.
MIT Department
Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Terms of Use
Creative Commons Attribution-Noncommercial-Share Alike
Persistent DSpace Link
DOI of Published Version
https://doi.org/10.1007/s11263-014-0748-y
