Unsupervised Adaptation from Repeated Traversals for Autonomous Driving

03/27/2023
by   Yurong You, et al.
0

For a self-driving car to operate reliably, its perceptual system must generalize to the end-user's environment – ideally without additional annotation efforts. One potential solution is to leverage unlabeled data (e.g., unlabeled LiDAR point clouds) collected from the end-users' environments (i.e. target domain) to adapt the system to the difference between training and testing environments. While extensive research has been done on such an unsupervised domain adaptation problem, one fundamental problem lingers: there is no reliable signal in the target domain to supervise the adaptation process. To overcome this issue we observe that it is easy to collect unsupervised data from multiple traversals of repeated routes. While different from conventional unsupervised domain adaptation, this assumption is extremely realistic since many drivers share the same roads. We show that this simple additional assumption is sufficient to obtain a potent signal that allows us to perform iterative self-training of 3D object detectors on the target domain. Concretely, we generate pseudo-labels with the out-of-domain detector but reduce false positives by removing detections of supposedly mobile objects that are persistent across traversals. Further, we reduce false negatives by encouraging predictions in regions that are not persistent. We experiment with our approach on two large-scale driving datasets and show remarkable improvement in 3D object detection of cars, pedestrians, and cyclists, bringing us a step closer to generalizable autonomous driving.

READ FULL TEXT

page 10

page 17

research
03/26/2021

Exploiting Playbacks in Unsupervised Domain Adaptation for 3D Object Detection

Self-driving cars must detect other vehicles and pedestrians in 3D to pl...
research
10/18/2021

FAST3D: Flow-Aware Self-Training for 3D Object Detectors

In the field of autonomous driving, self-training is widely applied to m...
research
09/21/2023

Unsupervised Domain Adaptation for Self-Driving from Past Traversal Features

The rapid development of 3D object detection systems for self-driving ca...
research
03/29/2022

Learning to Detect Mobile Objects from LiDAR Scans Without Labels

Current 3D object detectors for autonomous driving are almost entirely t...
research
12/01/2021

The Norm Must Go On: Dynamic Unsupervised Domain Adaptation by Normalization

Domain adaptation is crucial to adapt a learned model to new scenarios, ...
research
04/15/2019

Automatic adaptation of object detectors to new domains using self-training

This work addresses the unsupervised adaptation of an existing object de...
research
05/23/2022

Towards Model Generalization for Monocular 3D Object Detection

Monocular 3D object detection (Mono3D) has achieved tremendous improveme...

Please sign up or login with your details

Forgot password? Click here to reset