Multi Projection Fusion for Real-time Semantic Segmentation of 3D LiDAR Point Clouds

11/03/2020
by   Yara Ali Alnaggar, et al.
12

Semantic segmentation of 3D point cloud data is essential for enhanced high-level perception in autonomous platforms. Furthermore, given the increasing deployment of LiDAR sensors onboard of cars and drones, a special emphasis is also placed on non-computationally intensive algorithms that operate on mobile GPUs. Previous efficient state-of-the-art methods relied on 2D spherical projection of point clouds as input for 2D fully convolutional neural networks to balance the accuracy-speed trade-off. This paper introduces a novel approach for 3D point cloud semantic segmentation that exploits multiple projections of the point cloud to mitigate the loss of information inherent in single projection methods. Our Multi-Projection Fusion (MPF) framework analyzes spherical and bird's-eye view projections using two separate highly-efficient 2D fully convolutional models then combines the segmentation results of both views. The proposed framework is validated on the SemanticKITTI dataset where it achieved a mIoU of 55.5 which is higher than state-of-the-art projection-based methods RangeNet++ and PolarNet while being 1.6x faster than the former and 3.1x faster than the latter.

READ FULL TEXT

page 3

page 7

page 8

research
09/18/2019

SalsaNet: Fast Road and Vehicle Segmentation in LiDAR Point Clouds for Autonomous Driving

In this paper, we introduce a deep encoder-decoder network, named SalsaN...
research
02/25/2020

3D-MiniNet: Learning a 2D Representation from Point Clouds for Fast and Efficient 3D LIDAR Semantic Segmentation

LIDAR semantic segmentation, which assigns a semantic label to each 3D p...
research
04/21/2022

CPGNet: Cascade Point-Grid Fusion Network for Real-Time LiDAR Semantic Segmentation

LiDAR semantic segmentation essential for advanced autonomous driving is...
research
03/01/2021

FPS-Net: A Convolutional Fusion Network for Large-Scale LiDAR Point Cloud Segmentation

Scene understanding based on LiDAR point cloud is an essential task for ...
research
01/24/2023

RangeViT: Towards Vision Transformers for 3D Semantic Segmentation in Autonomous Driving

Casting semantic segmentation of outdoor LiDAR point clouds as a 2D prob...
research
08/24/2023

SCP: Spherical-Coordinate-based Learned Point Cloud Compression

In recent years, the task of learned point cloud compression has gained ...
research
10/24/2022

SphNet: A Spherical Network for Semantic Pointcloud Segmentation

Semantic segmentation for robotic systems can enable a wide range of app...

Please sign up or login with your details

Forgot password? Click here to reset