Repository logo
Log in(current)
Repository logoMIT Open ScholarshipDSpace@MIT
  1. Home
  2. MIT Open Access Articles
  3. MIT Open Access Articles
  4. Meta-Sim: Learning to Generate Synthetic Datasets
This is not the latest version of this item. The latest version can be found here.

Meta-Sim: Learning to Generate Synthetic Datasets

Thumbnail Image
Download
Name

1904.11621.pdf

Description
Submitted version
Size

8.54 MB

Format

Adobe PDF

Checksum (MD5)

7e5490fe2ef66484e619e7e20fe748e6

sword-2021-04-15T17:07:08.original.xml (130 B)
Original SWORD entry document
Date Issued
October 2020
Journal
Proceedings of the IEEE International Conference on Computer Vision
Publisher
IEEE
Citation
2020. "Meta-Sim: Learning to Generate Synthetic Datasets." Proceedings of the IEEE International Conference on Computer Vision, 2019-October.
Version
Original manuscript
Abstract
© 2019 IEEE. Training models to high-end performance requires availability of large labeled datasets, which are expensive to get. The goal of our work is to automatically synthesize labeled datasets that are relevant for a downstream task. We propose Meta-Sim, which learns a generative model of synthetic scenes, and obtain images as well as its corresponding ground-truth via a graphics engine. We parametrize our dataset generator with a neural network, which learns to modify attributes of scene graphs obtained from probabilistic scene grammars, so as to minimize the distribution gap between its rendered outputs and target data. If the real dataset comes with a small labeled validation set, we additionally aim to optimize a meta-objective, i.e. downstream task performance. Experiments show that the proposed method can greatly improve content generation quality over a human-engineered probabilistic scene grammar, both qualitatively and quantitatively as measured by performance on a downstream task.
Terms of Use
Creative Commons Attribution-Noncommercial-Share Alike
http://creativecommons.org/licenses/by-nc-sa/4.0/
Persistent DSpace Link
https://hdl.handle.net/1721.1/137178
DOI of Published Version
10.1109/ICCV.2019.00465
Repository logo
PrivacyPermissionsAccessibilityContact us
Repository logo
Notify us about copyright concerns.