Totems: Verifying the Integrity of Visual Information using Neural Light Field
Name
Ma-jingweim-meng-eecs-2021-thesis.pdf
Description
Thesis PDF
Size
38.76 MB
Format
Adobe PDF
Checksum (MD5)
4f3d49f5bf7cd8aeb0556ffb9f0aec3c
Author(s)
Ma, Jingwei
Advisor(s)
Torralba, Antonio
Date Issued
June 2021
Publisher
Massachusetts Institute of Technology
Abstract
In this work, we introduce a new approach to image forensics: physically placing a totem into the scene before taking a photo that needs to be protected from manipulations. A totem is any reflective or refractive object such that when placed in a scene, it displays a distorted version of the scene, which is called a totem view. When an image contains a totem, an adversary needs to modify both the totem view and the rest of the image (camera view) in a geometrically consistent manner in order to not have the manipulation detected. We assume that the adversary does not have access to totem shape and index of refraction (IoR), so achieving this consistency would be extremely difficult. Our work focuses on designing such algorithms that detect inconsistencies between the totem view and camera view given totem shape and IoR. In contrast to prior learning-based approaches that require large datasets of manipulated images, our methods are physics-based and work on a single image.
MIT Department
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Terms of Use
In Copyright - Educational Use Permitted
Copyright MIT
Persistent DSpace Link
