GPA-3D: Geometry-aware Prototype Alignment for Unsupervised Domain Adaptive 3D Object Detection from Point Clouds

08/16/2023
by   Ziyu Li, et al.
0

LiDAR-based 3D detection has made great progress in recent years. However, the performance of 3D detectors is considerably limited when deployed in unseen environments, owing to the severe domain gap problem. Existing domain adaptive 3D detection methods do not adequately consider the problem of the distributional discrepancy in feature space, thereby hindering generalization of detectors across domains. In this work, we propose a novel unsupervised domain adaptive 3D detection framework, namely Geometry-aware Prototype Alignment (GPA-3D), which explicitly leverages the intrinsic geometric relationship from point cloud objects to reduce the feature discrepancy, thus facilitating cross-domain transferring. Specifically, GPA-3D assigns a series of tailored and learnable prototypes to point cloud objects with distinct geometric structures. Each prototype aligns BEV (bird's-eye-view) features derived from corresponding point cloud objects on source and target domains, reducing the distributional discrepancy and achieving better adaptation. The evaluation results obtained on various benchmarks, including Waymo, nuScenes and KITTI, demonstrate the superiority of our GPA-3D over the state-of-the-art approaches for different adaptation scenarios. The MindSpore version code will be publicly available at <https://github.com/Liz66666/GPA3D>.

READ FULL TEXT

page 3

page 13

research
08/20/2021

Geometry-Aware Self-Training for Unsupervised Domain Adaptationon Object Point Clouds

The point cloud representation of an object can have a large geometric v...
research
10/16/2020

SF-UDA^3D: Source-Free Unsupervised Domain Adaptation for LiDAR-Based 3D Object Detection

3D object detectors based only on LiDAR point clouds hold the state-of-t...
research
05/16/2023

SUG: Single-dataset Unified Generalization for 3D Point Cloud Classification

Although Domain Generalization (DG) problem has been fast-growing in the...
research
11/07/2019

PointDAN: A Multi-Scale 3D Domain Adaption Network for Point Cloud Representation

Domain Adaptation (DA) approaches achieved significant improvements in a...
research
11/17/2021

See Eye to Eye: A Lidar-Agnostic 3D Detection Framework for Unsupervised Multi-Target Domain Adaptation

Sampling discrepancies between different manufacturers and models of lid...
research
03/29/2022

Task-specific Inconsistency Alignment for Domain Adaptive Object Detection

Detectors trained with massive labeled data often exhibit dramatic perfo...
research
08/24/2022

AGO-Net: Association-Guided 3D Point Cloud Object Detection Network

The human brain can effortlessly recognize and localize objects, whereas...

Please sign up or login with your details

Forgot password? Click here to reset