DODA: Data-oriented Sim-to-Real Domain Adaptation for 3D Indoor Semantic Segmentation

by   Runyu Ding, et al.
Max Planck Society
The University of Hong Kong

Deep learning approaches achieve prominent success in 3D semantic segmentation. However, collecting densely annotated real-world 3D datasets is extremely time-consuming and expensive. Training models on synthetic data and generalizing on real-world scenarios becomes an appealing alternative, but unfortunately suffers from notorious domain shifts. In this work, we propose a Data-Oriented Domain Adaptation (DODA) framework to mitigate pattern and context gaps caused by different sensing mechanisms and layout placements across domains. Our DODA encompasses virtual scan simulation to imitate real-world point cloud patterns and tail-aware cuboid mixing to alleviate the interior context gap with a cuboid-based intermediate domain. The first unsupervised sim-to-real adaptation benchmark on 3D indoor semantic segmentation is also built on 3D-FRONT, ScanNet and S3DIS along with 7 popular Unsupervised Domain Adaptation (UDA) methods. Our DODA surpasses existing UDA approaches by over 13 → S3DIS. Code will be available.


Labeling Where Adapting Fails: Cross-Domain Semantic Segmentation with Point Supervision via Active Selection

Training models dedicated to semantic segmentation requires a large amou...

CoSMix: Compositional Semantic Mix for Domain Adaptation in 3D LiDAR Segmentation

3D LiDAR semantic segmentation is fundamental for autonomous driving. Se...

Phase Consistent Ecological Domain Adaptation

We introduce two criteria to regularize the optimization involved in lea...

Transfer beyond the Field of View: Dense Panoramic Semantic Segmentation via Unsupervised Domain Adaptation

Autonomous vehicles clearly benefit from the expanded Field of View (FoV...

To Adapt or Not to Adapt? Real-Time Adaptation for Semantic Segmentation

The goal of Online Domain Adaptation for semantic segmentation is to han...

Synthetic-to-Real Domain Generalized Semantic Segmentation for 3D Indoor Point Clouds

Semantic segmentation in 3D indoor scenes has achieved remarkable perfor...

Localising In Complex Scenes Using Balanced Adversarial Adaptation

Domain adaptation and generative modelling have collectively mitigated t...

Please sign up or login with your details

Forgot password? Click here to reset