Meta-Sim: Learning to Generate Synthetic Datasets

04/25/2019
by   Amlan Kar, et al.
12

Training models to high-end performance requires availability of large labeled datasets, which are expensive to get. The goal of our work is to automatically synthesize labeled datasets that are relevant for a downstream task. We propose Meta-Sim, which learns a generative model of synthetic scenes, and obtain images as well as its corresponding ground-truth via a graphics engine. We parametrize our dataset generator with a neural network, which learns to modify attributes of scene graphs obtained from probabilistic scene grammars, so as to minimize the distribution gap between its rendered outputs and target data. If the real dataset comes with a small labeled validation set, we additionally aim to optimize a meta-objective, i.e. downstream task performance. Experiments show that the proposed method can greatly improve content generation quality over a human-engineered probabilistic scene grammar, both qualitatively and quantitatively as measured by performance on a downstream task.

READ FULL TEXT

page 4

page 6

page 7

page 8

page 9

page 10

page 11

page 12

research
08/20/2020

Meta-Sim2: Unsupervised Learning of Scene Structure for Synthetic Data Generation

Procedural models are being widely used to synthesize scenes for graphic...
research
10/22/2021

MIGS: Meta Image Generation from Scene Graphs

Generation of images from scene graphs is a promising direction towards ...
research
12/10/2019

Learning to generate new indoor scenes

Deep generative models have been used in recent years to learn coherent ...
research
11/30/2020

Sim2SG: Sim-to-Real Scene Graph Generation for Transfer Learning

Scene graph (SG) generation has been gaining a lot of traction recently....
research
12/08/2022

PromptonomyViT: Multi-Task Prompt Learning Improves Video Transformers using Synthetic Scene Data

Action recognition models have achieved impressive results by incorporat...
research
10/14/2022

Meta Transferring for Deblurring

Most previous deblurring methods were built with a generic model trained...
research
09/13/2022

Placing Human Animations into 3D Scenes by Learning Interaction- and Geometry-Driven Keyframes

We present a novel method for placing a 3D human animation into a 3D sce...

Please sign up or login with your details

Forgot password? Click here to reset