SqueezeSegV2: Improved Model Structure and Unsupervised Domain Adaptation for Road-Object Segmentation from a LiDAR Point Cloud

09/22/2018
by   Bichen Wu, et al.
10

Earlier work demonstrates the promise of deep-learning-based approaches for point cloud segmentation; however, these approaches need to be improved to be practically useful. To this end, we introduce a new model SqueezeSegV2 that is more robust to dropout noise in LiDAR point clouds. With improved model structure, training loss, batch normalization and additional input channel, SqueezeSegV2 achieves significant accuracy improvement when trained on real data. Training models for point cloud segmentation requires large amounts of labeled point-cloud data, which is expensive to obtain. To sidestep the cost of collection and annotation, simulators such as GTA-V can be used to create unlimited amounts of labeled, synthetic data. However, due to domain shift, models trained on synthetic data often do not generalize well to the real world. We address this problem with a domain-adaptation training pipeline consisting of three major components: 1) learned intensity rendering, 2) geodesic correlation alignment, and 3) progressive domain calibration. When trained on real data, our new model exhibits segmentation accuracy improvements of 6.0-8.6 synthetic data using the proposed domain adaptation pipeline, we nearly double test accuracy on real-world data, from 29.0 synthetic dataset will be open-sourced.

READ FULL TEXT

page 1

page 5

page 6

research
07/20/2022

CoSMix: Compositional Semantic Mix for Domain Adaptation in 3D LiDAR Segmentation

3D LiDAR semantic segmentation is fundamental for autonomous driving. Se...
research
08/28/2023

Compositional Semantic Mix for Domain Adaptation in Point Cloud Segmentation

Deep-learning models for 3D point cloud semantic segmentation exhibit li...
research
07/20/2022

GIPSO: Geometrically Informed Propagation for Online Adaptation in 3D LiDAR Segmentation

3D point cloud semantic segmentation is fundamental for autonomous drivi...
research
03/08/2022

Quasi-Balanced Self-Training on Noise-Aware Synthesis of Object Point Clouds for Closing Domain Gap

Semantic analyses of object point clouds are largely driven by releasing...
research
10/17/2022

PCGen: Point Cloud Generator for LiDAR Simulation

Data is a fundamental building block for LiDAR perception systems. Unfor...
research
08/21/2020

Generating synthetic photogrammetric data for training deep learning based 3D point cloud segmentation models

At I/ITSEC 2019, the authors presented a fully-automated workflow to seg...
research
01/12/2023

Sim2real Transfer Learning for Point Cloud Segmentation: An Industrial Application Case on Autonomous Disassembly

On robotics computer vision tasks, generating and annotating large amoun...

Please sign up or login with your details

Forgot password? Click here to reset