Reasoning about objects under full occlusion
Name
1078638333-MIT.pdf
Description
Full printable version
Size
2.6 MB
Format
Adobe PDF
Checksum (MD5)
2fbb04d23b2e87291893e21d7b5f5e81
Author(s)
Ray Chaudhuri, Shraman
Advisor(s)
Joshua B. Tenenbaum.
Date Issued
2018
Publisher
Massachusetts Institute of Technology
Abstract
While state-of-the-art machine learning models can outperform humans on certain tasks, most of them generalize poorly across domains and cannot reason about complex scenes. In this paper, we attempt to resolve this shortcoming by incorporating a physics engine as a prior for scene understanding. We test our approach on two computer vision tasks -- pose estimation and object matching -- under full occlusion, and demonstrate superior performance over state-of-the-art methods. We also present a preliminary case study which demonstrates that our model is consistent with human behavior. Our work demonstrates a successful approach to a novel and challenging task, provides a general framework to infer latent factors of scene via physics simulation, and extends support for intuitive physics-based approaches for robust visual reasoning.
Description
Thesis: M. Eng., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2018.
This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections.
Cataloged from student-submitted PDF version of thesis.
Includes bibliographical references (pages 41-43).
Subjects
Electrical Engineering and Computer Science.
MIT Department
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Terms of Use
MIT theses are protected by copyright. They may be viewed, downloaded, or printed from this source but further reproduction or distribution in any format is prohibited without written permission.
Persistent DSpace Link