Domain Stylization: A Strong, Simple Baseline for Synthetic to Real Image Domain Adaptation

07/24/2018
by   Aysegul Dundar, et al.
1

Deep neural networks have largely failed to effectively utilize synthetic data when applied to real images due to the covariate shift problem. In this paper, we show that by applying a straightforward modification to an existing photorealistic style transfer algorithm, we achieve state-of-the-art synthetic-to-real domain adaptation results. We conduct extensive experimental validations on four synthetic-to-real tasks for semantic segmentation and object detection, and show that our approach exceeds the performance of any current state-of-the-art GAN-based image translation approach as measured by segmentation and object detection metrics. Furthermore we offer a distance based analysis of our method which shows a dramatic reduction in Frechet Inception distance between the source and target domains, offering a quantitative metric that demonstrates the effectiveness of our algorithm in bridging the synthetic-to-real gap.

READ FULL TEXT

page 3

page 4

research
09/02/2020

Semantically Adaptive Image-to-image Translation for Domain Adaptation of Semantic Segmentation

Domain shift is a very challenging problem for semantic segmentation. An...
research
04/25/2022

ProCST: Boosting Semantic Segmentation using Progressive Cyclic Style-Transfer

Using synthetic data for training neural networks that achieve good perf...
research
08/31/2022

AWADA: Attention-Weighted Adversarial Domain Adaptation for Object Detection

Object detection networks have reached an impressive performance level, ...
research
03/17/2023

Synthetic-to-Real Domain Adaptation for Action Recognition: A Dataset and Baseline Performances

Human action recognition is a challenging problem, particularly when the...
research
10/14/2022

Synthetic-to-real Composite Semantic Segmentation in Additive Manufacturing

The application of computer vision and machine learning methods in the f...
research
09/17/2018

Sensor Transfer: Learning Optimal Sensor Effect Image Augmentation for Sim-to-Real Domain Adaptation

Performance on benchmark datasets has drastically improved with advances...
research
11/30/2017

ROAD: Reality Oriented Adaptation for Semantic Segmentation of Urban Scenes

Exploiting synthetic data to learn deep models has attracted increasing ...

Please sign up or login with your details

Forgot password? Click here to reset