GeneSIS-RT: Generating Synthetic Images for training Secondary Real-world Tasks

10/11/2017
by   Gregory J. Stein, et al.
0

We propose a novel approach for generating high-quality, synthetic data for domain-specific learning tasks, for which training data may not be readily available. We leverage recent progress in image-to-image translation to bridge the gap between simulated and real images, allowing us to generate realistic training data for real-world tasks using only unlabeled real-world images and a simulation. GeneSIS-RT ameliorates the burden of having to collect labeled real-world images and is a promising candidate for generating high-quality, domain-specific, synthetic data. To show the effectiveness of using GeneSIS-RT to create training data, we study two tasks: semantic segmentation and reactive obstacle avoidance. We demonstrate that learning algorithms trained using data generated by GeneSIS-RT make high-accuracy predictions and outperform systems trained on raw simulated data alone, and as well or better than those trained on real data. Finally, we use our data to train a quadcopter to fly 60 meters at speeds up to 3.4 m/s through a cluttered environment, demonstrating that our GeneSIS-RT images can be used to learn to perform mission-critical tasks.

READ FULL TEXT

page 1

page 3

page 4

page 6

page 7

research
07/05/2019

Generating large labeled data sets for laparoscopic image processing tasks using unpaired image-to-image translation

In the medical domain, the lack of large training data sets and benchmar...
research
06/30/2020

A Simple Domain Shifting Networkfor Generating Low Quality Images

Deep Learning systems have proven to be extremely successful for image r...
research
05/20/2022

Automatic Generation of Synthetic Colonoscopy Videos for Domain Randomization

An increasing number of colonoscopic guidance and assistance systems rel...
research
03/07/2021

Learn to Differ: Sim2Real Small Defection Segmentation Network

Recent studies on deep-learning-based small defection segmentation appro...
research
05/31/2022

Hands-Up: Leveraging Synthetic Data for Hands-On-Wheel Detection

Over the past few years there has been major progress in the field of sy...
research
09/27/2022

Identifying and Extracting Football Features from Real-World Media Sources using Only Synthetic Training Data

Real-world images used for training machine learning algorithms are ofte...
research
11/15/2022

Data-Driven Occupancy Grid Mapping using Synthetic and Real-World Data

In perception tasks of automated vehicles (AVs) data-driven have often o...

Please sign up or login with your details

Forgot password? Click here to reset