Attention-based Adversarial Appearance Learning of Augmented Pedestrians

07/06/2021
by   Kevin Strauss, et al.
25

Synthetic data became already an essential component of machine learning-based perception in the field of autonomous driving. Yet it still cannot replace real data completely due to the sim2real domain shift. In this work, we propose a method that leverages the advantages of the augmentation process and adversarial training to synthesize realistic data for the pedestrian recognition task. Our approach utilizes an attention mechanism driven by an adversarial loss to learn domain discrepancies and improve sim2real adaptation. Our experiments confirm that the proposed adaptation method is robust to such discrepancies and reveals both visual realism and semantic consistency. Furthermore, we evaluate our data generation pipeline on the task of pedestrian recognition and demonstrate that generated data resemble properties of the real domain.

READ FULL TEXT

page 1

page 3

page 6

page 7

research
04/05/2018

Pedestrian-Synthesis-GAN: Generating Pedestrian Data in Real Scene and Beyond

State-of-the-art pedestrian detection models have achieved great success...
research
05/26/2021

KLIEP-based Density Ratio Estimation for Semantically Consistent Synthetic to Real Images Adaptation in Urban Traffic Scenes

Synthetic data has been applied in many deep learning based computer vis...
research
12/15/2019

A Shape Transformation-based Dataset Augmentation Framework for Pedestrian Detection

Deep learning-based computer vision is usually data-hungry. Many researc...
research
02/03/2021

Robust pedestrian detection in thermal imagery using synthesized images

In this paper we propose a method for improving pedestrian detection in ...
research
06/16/2022

SHIFT: A Synthetic Driving Dataset for Continuous Multi-Task Domain Adaptation

Adapting to a continuously evolving environment is a safety-critical cha...
research
03/18/2017

Expecting the Unexpected: Training Detectors for Unusual Pedestrians with Adversarial Imposters

As autonomous vehicles become an every-day reality, high-accuracy pedest...
research
10/09/2018

Seeing Beyond Appearance - Mapping Real Images into Geometrical Domains for Unsupervised CAD-based Recognition

While convolutional neural networks are dominating the field of computer...

Please sign up or login with your details

Forgot password? Click here to reset