SphNet: A Spherical Network for Semantic Pointcloud Segmentation

10/24/2022
by   Lukas Bernreiter, et al.
0

Semantic segmentation for robotic systems can enable a wide range of applications, from self-driving cars and augmented reality systems to domestic robots. We argue that a spherical representation is a natural one for egocentric pointclouds. Thus, in this work, we present a novel framework exploiting such a representation of LiDAR pointclouds for the task of semantic segmentation. Our approach is based on a spherical convolutional neural network that can seamlessly handle observations from various sensor systems (e.g., different LiDAR systems) and provides an accurate segmentation of the environment. We operate in two distinct stages: First, we encode the projected input pointclouds to spherical features. Second, we decode and back-project the spherical features to achieve an accurate semantic segmentation of the pointcloud. We evaluate our method with respect to state-of-the-art projection-based semantic segmentation approaches using well-known public datasets. We demonstrate that the spherical representation enables us to provide more accurate segmentation and to have a better generalization to sensors with different field-of-view and number of beams than what was seen during training.

READ FULL TEXT

page 1

page 3

page 6

research
05/21/2019

Convolutions on Spherical Images

Applying convolutional neural networks to spherical images requires part...
research
06/07/2021

Multi-Exit Semantic Segmentation Networks

Semantic segmentation arises as the backbone of many vision systems, spa...
research
07/05/2023

Spherical Feature Pyramid Networks For Semantic Segmentation

Semantic segmentation for spherical data is a challenging problem in mac...
research
02/25/2020

3D-MiniNet: Learning a 2D Representation from Point Clouds for Fast and Efficient 3D LIDAR Semantic Segmentation

LIDAR semantic segmentation, which assigns a semantic label to each 3D p...
research
11/03/2020

Multi Projection Fusion for Real-time Semantic Segmentation of 3D LiDAR Point Clouds

Semantic segmentation of 3D point cloud data is essential for enhanced h...
research
07/01/2021

MASS: Multi-Attentional Semantic Segmentation of LiDAR Data for Dense Top-View Understanding

At the heart of all automated driving systems is the ability to sense th...
research
06/06/2023

SGAT4PASS: Spherical Geometry-Aware Transformer for PAnoramic Semantic Segmentation

As an important and challenging problem in computer vision, PAnoramic Se...

Please sign up or login with your details

Forgot password? Click here to reset