Efficient Urban-scale Point Clouds Segmentation with BEV Projection

09/19/2021
by   Zhenhong Zou, et al.
0

Point clouds analysis has grasped researchers' eyes in recent years, while 3D semantic segmentation remains a problem. Most deep point clouds models directly conduct learning on 3D point clouds, which will suffer from the severe sparsity and extreme data processing load in urban-scale data. To tackle the challenge, we propose to transfer the 3D point clouds to dense bird's-eye-view projection. In this case, the segmentation task is simplified because of class unbalance reduction and the feasibility of leveraging various 2D segmentation methods. We further design an attention-based fusion network that can conduct multi-modal learning on the projected images. Finally, the 2D out are remapped to generate 3D semantic segmentation results. To demonstrate the benefits of our method, we conduct various experiments on the SensatUrban dataset, in which our model presents competitive evaluation results (61.17 OverallAccuracy). We hope our work can inspire further exploration in point cloud analysis.

READ FULL TEXT

page 2

page 4

page 5

research
08/31/2021

Automatic labelling of urban point clouds using data fusion

In this paper we describe an approach to semi-automatically create a lab...
research
11/30/2018

Multiview Based 3D Scene Understanding On Partial Point Sets

Deep learning within the context of point clouds has gained much researc...
research
03/10/2023

Combining visibility analysis and deep learning for refinement of semantic 3D building models by conflict classification

Semantic 3D building models are widely available and used in numerous ap...
research
09/25/2019

Learning Propagation for Arbitrarily-structured Data

Processing an input signal that contains arbitrary structures, e.g., sup...
research
04/18/2023

Unsupervised Semantic Segmentation of 3D Point Clouds via Cross-modal Distillation and Super-Voxel Clustering

Semantic segmentation of point clouds usually requires exhausting effort...
research
05/09/2017

Deep Projective 3D Semantic Segmentation

Semantic segmentation of 3D point clouds is a challenging problem with n...
research
03/20/2023

Semantic 3D scene segmentation for robotic assembly process execution

Adapting robot programmes to changes in the environment is a well-known ...

Please sign up or login with your details

Forgot password? Click here to reset