Content Disentanglement for Semantically Consistent Synthetic-to-RealDomain Adaptation in Urban Traffic Scenes

05/18/2021
by   Mert Keser, et al.
0

Synthetic data generation is an appealing approach to generate novel traffic scenarios in autonomous driving. However, deep learning techniques trained solely on synthetic data encounter dramatic performance drops when they are tested on real data. Such performance drop is commonly attributed to the domain gap between real and synthetic data. Domain adaptation methods have been applied to mitigate the aforementioned domain gap. These methods achieve visually appealing results, but the translated samples usually introduce semantic inconsistencies. In this work, we propose a new, unsupervised, end-to-end domain adaptation network architecture that enables semantically consistent domain adaptation between synthetic and real data. We evaluate our architecture on the downstream task of semantic segmentation and show that our method achieves superior performance compared to the state-of-the-art methods.

READ FULL TEXT

page 2

page 3

page 5

research
05/26/2021

KLIEP-based Density Ratio Estimation for Semantically Consistent Synthetic to Real Images Adaptation in Urban Traffic Scenes

Synthetic data has been applied in many deep learning based computer vis...
research
11/30/2017

ROAD: Reality Oriented Adaptation for Semantic Segmentation of Urban Scenes

Exploiting synthetic data to learn deep models has attracted increasing ...
research
02/08/2023

Domain Adaptation of Synthetic Driving Datasets for Real-World Autonomous Driving

While developing perception based deep learning models, the benefit of s...
research
09/04/2018

Penalizing Top Performers: Conservative Loss for Semantic Segmentation Adaptation

Due to the expensive and time-consuming annotations (e.g., segmentation)...
research
04/20/2023

SCoDA: Domain Adaptive Shape Completion for Real Scans

3D shape completion from point clouds is a challenging task, especially ...
research
02/06/2023

Domain-Indexing Variational Bayes: Interpretable Domain Index for Domain Adaptation

Previous studies have shown that leveraging domain index can significant...
research
04/25/2020

StRDAN: Synthetic-to-Real Domain Adaptation Network for Vehicle Re-Identification

Vehicle re-identification aims to obtain the same vehicles from vehicle ...

Please sign up or login with your details

Forgot password? Click here to reset