Learning to Generate Synthetic 3D Training Data through Hybrid Gradient

06/29/2019
by   Dawei Yang, et al.
3

Synthetic images rendered by graphics engines are a promising source for training deep networks. However, it is challenging to ensure that they can help train a network to perform well on real images, because a graphics-based generation pipeline requires numerous design decisions such as the selection of 3D shapes and the placement of the camera. In this work, we propose a new method that optimizes the generation of 3D training data based on what we call "hybrid gradient". We parametrize the design decisions as a real vector, and combine the approximate gradient and the analytical gradient to obtain the hybrid gradient of the network performance with respect to this vector. We evaluate our approach on the task of estimating surface normals from a single image. Experiments on standard benchmarks show that our approach can outperform the prior state of the art on optimizing the generation of 3D training data, particularly in terms of computational efficiency.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/04/2021

Im2Vec: Synthesizing Vector Graphics without Vector Supervision

Vector graphics are widely used to represent fonts, logos, digital artwo...
research
12/08/2017

Shape from Shading through Shape Evolution

In this paper, we address the shape-from-shading problem by training dee...
research
04/28/2019

Synthetic Data Generation and Adaption for Object Detection in Smart Vending Machines

This paper presents an improved scheme for the generation and adaption o...
research
03/17/2022

Synthetic-to-Real Domain Adaptation using Contrastive Unpaired Translation

The usefulness of deep learning models in robotics is largely dependent ...
research
04/05/2016

Comparative Deep Learning of Hybrid Representations for Image Recommendations

In many image-related tasks, learning expressive and discriminative repr...
research
01/14/2021

A Pipeline for Vision-Based On-Orbit Proximity Operations Using Deep Learning and Synthetic Imagery

Deep learning has become the gold standard for image processing over the...
research
03/02/2021

Dual Reinforcement-Based Specification Generation for Image De-Rendering

Advances in deep learning have led to promising progress in inferring gr...

Please sign up or login with your details

Forgot password? Click here to reset