3D-MiniNet: Learning a 2D Representation from Point Clouds for Fast and Efficient 3D LIDAR Semantic Segmentation

02/25/2020
by   Iñigo Alonso, et al.
0

LIDAR semantic segmentation, which assigns a semantic label to each 3D point measured by the LIDAR, is becoming an essential task for many robotic applications such as autonomous driving. Fast and efficient semantic segmentation methods are needed to match the strong computational and temporal restrictions of many of these real-world applications. This work presents 3D-MiniNet, a novel approach for LIDAR semantic segmentation that combines 3D and 2D learning layers. It first learns a 2D representation from the raw points through a novel projection which extracts local and global information from the 3D data. This representation is fed to an efficient 2D Fully Convolutional Neural Network (FCNN) that produces a 2D semantic segmentation. These 2D semantic labels are re-projected back to the 3D space and enhanced through a post-processing module. The main novelty in our strategy relies on the projection learning module. Our detailed ablation study shows how each component contributes to the final performance of 3D-MiniNet. We validate our approach on well known public benchmarks (SemanticKITTI and KITTI), where 3D-MiniNet gets state-of-the-art results while being faster and more parameter-efficient than previous methods.

READ FULL TEXT

page 1

page 7

research
11/03/2020

Multi Projection Fusion for Real-time Semantic Segmentation of 3D LiDAR Point Clouds

Semantic segmentation of 3D point cloud data is essential for enhanced h...
research
09/08/2021

FIDNet: LiDAR Point Cloud Semantic Segmentation with Fully Interpolation Decoding

Projecting the point cloud on the 2D spherical range image transforms th...
research
07/24/2020

KPRNet: Improving projection-based LiDAR semantic segmentation

Semantic segmentation is an important component in the perception system...
research
07/04/2022

Open-world Semantic Segmentation for LIDAR Point Clouds

Current methods for LIDAR semantic segmentation are not robust enough fo...
research
10/24/2022

SphNet: A Spherical Network for Semantic Pointcloud Segmentation

Semantic segmentation for robotic systems can enable a wide range of app...
research
09/12/2023

360^∘ from a Single Camera: A Few-Shot Approach for LiDAR Segmentation

Deep learning applications on LiDAR data suffer from a strong domain gap...
research
08/24/2020

TORNADO-Net: mulTiview tOtal vaRiatioN semAntic segmentation with Diamond inceptiOn module

Semantic segmentation of point clouds is a key component of scene unders...

Please sign up or login with your details

Forgot password? Click here to reset