Understanding Human Perception Through MooneyFaces
Name
arora-riya-meng-eecs-2023-thesis.pdf
Description
Thesis PDF
Size
11.82 MB
Format
Adobe PDF
Checksum (MD5)
4fe5919744f3d190c021468cbaa5a154
Author(s)
Arora, Riya
Advisor(s)
Siegel, Max
Egger, Bernhard
Tenenbaum, Joshua B.
Date Issued
June 2023
Publisher
Massachusetts Institute of Technology
Abstract
Human vision is remarkably tolerant to image distortions: even when every pixel in an image has been destructively altered, as in classic Mooney displays, humans can still extract information about identity, pose, and more. Most current deep learning computer vision models perform well with standard face images, but they struggle with stimuli which differ from their training data, like Mooney faces. What makes human perception so comparatively robust? We consider a version of the analysis-by-synthesis proposal for perception, in which visual input is interpreted by inverting a model of image formation, as a potential model for human visual perception. Taking Mooney faces as a case study, we evaluate the model against human performance in a test domain, determining head pose, with the objective of replicating human perception. Previous human psychophysical studies have identified an illusion in which the perceived pose of a Mooney face differs from the pose recovered from an uncorrupted image. The analysis-by-synthesis model does not show a similar effect.
MIT Department
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Terms of Use
In Copyright - Educational Use Permitted
Copyright retained by author(s)
Persistent DSpace Link
