Evaluation of image features using a photorealistic virtual world
Name
Freeman-Evaluation of image.pdf
Size
2.06 MB
Format
Adobe PDF
Checksum (MD5)
49066dbfaf2cd70e4c14f16ca88eec4a
Author(s)
Kaneva, Biliana K.
Torralba, Antonio
Freeman, William T.
Date Issued
November 2011
Journal
IEEE International Conference on Computer Vision 2011 (ICCV)
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Citation
Kaneva, Biliana, Antonio Torralba, and William T. Freeman. “Evaluation of Image Features Using a Photorealistic Virtual World.” IEEE International Conference on Computer Vision 2011 (ICCV). 2282–2289.
Version
Author's final manuscript
Abstract
Image features are widely used in computer vision applications. They need to be robust to scene changes and image transformations. Designing and comparing feature descriptors requires the ability to evaluate their performance with respect to those transformations. We want to know how robust the descriptors are to changes in the lighting, scene, or viewing conditions. For this, we need ground truth data of different scenes viewed under different camera or lighting conditions in a controlled way. Such data is very difficult to gather in a real-world setting. We propose using a photorealistic virtual world to gain complete and repeatable control of the environment in order to evaluate image features. We calibrate our virtual world evaluations by comparing against feature rankings made from photographic data of the same subject matter (the Statue of Liberty). We find very similar feature rankings between the two datasets. We then use our virtual world to study the effects on descriptor performance of controlled changes in viewpoint and illumination. We also study the effect of augmenting the descriptors with depth information to improve performance.
MIT Department
Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Terms of Use
Creative Commons Attribution-Noncommercial-Share Alike 3.0
Persistent DSpace Link
DOI of Published Version
https://doi.org/10.1109/ICCV.2011.6126508
