Reasoning about objects under full occlusion
Author(s)Ray Chaudhuri, Shraman
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science.
Joshua B. Tenenbaum.
MetadataShow full item record
While state-of-the-art machine learning models can outperform humans on certain tasks, most of them generalize poorly across domains and cannot reason about complex scenes. In this paper, we attempt to resolve this shortcoming by incorporating a physics engine as a prior for scene understanding. We test our approach on two computer vision tasks -- pose estimation and object matching -- under full occlusion, and demonstrate superior performance over state-of-the-art methods. We also present a preliminary case study which demonstrates that our model is consistent with human behavior. Our work demonstrates a successful approach to a novel and challenging task, provides a general framework to infer latent factors of scene via physics simulation, and extends support for intuitive physics-based approaches for robust visual reasoning.
Thesis: M. Eng., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2018.This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections.Cataloged from student-submitted PDF version of thesis.Includes bibliographical references (pages 41-43).
DepartmentMassachusetts Institute of Technology. Department of Electrical Engineering and Computer Science.
Massachusetts Institute of Technology
Electrical Engineering and Computer Science.