Synthetic-to-Real Domain Adaptation for Lane Detection

by   Noa Garnett, et al.

Accurate lane detection, a crucial enabler for autonomous driving, currently relies on obtaining a large and diverse labeled training dataset. In this work, we explore learning from abundant, randomly generated synthetic data, together with unlabeled or partially labeled target domain data, instead. Randomly generated synthetic data has the advantage of controlled variability in the lane geometry and lighting, but it is limited in terms of photo-realism. This poses the challenge of adapting models learned on the unrealistic synthetic domain to real images. To this end we develop a novel autoencoder-based approach that uses synthetic labels unaligned with particular images for adapting to target domain data. In addition, we explore existing domain adaptation approaches, such as image translation and self-supervision, and adjust them to the lane detection task. We test all approaches in the unsupervised domain adaptation setting in which no target domain labels are available and in the semi-supervised setting in which a small portion of the target images are labeled. In extensive experiments using three different datasets, we demonstrate the possibility to save costly target domain labeling efforts. For example, using our proposed autoencoder approach on the llamas and tuSimple lane datasets, we can almost recover the fully supervised accuracy with only 10 outperforms all other methods in the semi-supervised domain adaptation scenario.


page 3

page 8

page 19


Sim-to-Real Domain Adaptation for Lane Detection and Classification in Autonomous Driving

While supervised detection and classification frameworks in autonomous d...

CARLANE: A Lane Detection Benchmark for Unsupervised Domain Adaptation from Simulation to multiple Real-World Domains

Unsupervised Domain Adaptation demonstrates great potential to mitigate ...

Domain Adaptation-based Augmentation for Weakly Supervised Nuclei Detection

The detection of nuclei is one of the most fundamental components of com...

Semi-supervised Large-scale Fiber Detection in Material Images with Synthetic Data

Accurate detection of large-scale, elliptical-shape fibers, including th...

Deep CG2Real: Synthetic-to-Real Translation via Image Disentanglement

We present a method to improve the visual realism of low-quality, synthe...

Bridging the Sim2Real gap with CARE: Supervised Detection Adaptation with Conditional Alignment and Reweighting

Sim2Real domain adaptation (DA) research focuses on the constrained sett...

Domain Adaptation for Autoencoder-Based End-to-End Communication Over Wireless Channels

The problem of domain adaptation conventionally considers the setting wh...

Please sign up or login with your details

Forgot password? Click here to reset