GANalyze: Toward Visual Definitions of Cognitive Image Properties
Name
1906.10112.pdf
Description
Submitted version
Size
9.48 MB
Format
Adobe PDF
Checksum (MD5)
02b1b182f08d3eccf38e38f726431abb
Author(s)
Goetschalckx, Lore
Andonian, Alexander J
Oliva, Aude
Isola, Phillip John
Date Issued
October 2020
Journal
2019 IEEE/CVF International Conference on Computer Vision (ICCV)
Publisher
IEEE
Citation
Goetschalckx, Lore et al. “GANalyze: Toward Visual Definitions of Cognitive Image Properties.” Paper in the Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision (ICCV), 27 October-2 November 2019, Seoul, Korea, IEEE, © 2019 The Author(s)
Version
Original manuscript
Abstract
We introduce a framework that uses Generative Adversarial Networks (GANs) to study cognitive properties like memorability, aesthetics, and emotional valence. These attributes are of interest because we do not have a concrete visual definition of what they entail. What does it look like for a dog to be more memorable? GANs allow us to generate a manifold of natural-looking images with fine-grained differences in their visual attributes. By navigating this manifold in directions that increase memorability, we can visualize what it looks like for a particular generated image to become more memorable. The resulting ''visual definitions' surface image properties (like ''object size') that may underlie memorability. Through behavioral experiments, we verify that our method indeed discovers image manipulations that causally affect human memory performance. We further demonstrate that the same framework can be used to analyze image aesthetics and emotional valence. ganalyze.csail.mit.edu.
MIT Department
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory
Terms of Use
Creative Commons Attribution-Noncommercial-Share Alike
Persistent DSpace Link
DOI of Published Version
https://doi.org/10.1109/ICCV.2019.00584
