A Dataset for Semantic Segmentation of Point Cloud Sequences

04/02/2019
by   Jens Behley, et al.
0

Semantic scene understanding is important for various applications. In particular, self-driving cars need a fine-grained understanding of the surfaces and objects in their vicinity. Light detection and ranging (LiDAR) provides precise geometric information about the environment and is thus a part of the sensor suites of almost all self-driving cars. Despite the relevance of semantic scene understanding for this application, there is a lack of a large dataset for this task which is based on an automotive LiDAR. In this paper, we introduce a large dataset to propel research on laser-based semantic segmentation. We annotated all sequences of the KITTI Vision Odometry Benchmark and provide dense point-wise annotations for the complete 360^o field-of-view of the employed automotive LiDAR. We propose three benchmark tasks based on this dataset: (i) semantic segmentation of point clouds using a single scan, (ii) semantic segmentation using sequences comprised of multiple past scans, and (iii) semantic scene completion, which requires to anticipate the semantic scene in the future. We provide baseline experiments and show that there is a need for more sophisticated models to efficiently tackle these tasks. Our dataset opens the door for the development of more advanced methods, but also provides plentiful data to investigate new research directions.

READ FULL TEXT

page 1

page 4

page 8

page 12

page 16

page 18

research
03/04/2020

A Benchmark for LiDAR-based Panoptic Segmentation based on KITTI

Panoptic segmentation is the recently introduced task that tackles seman...
research
07/01/2021

MASS: Multi-Attentional Semantic Segmentation of LiDAR Data for Dense Top-View Understanding

At the heart of all automated driving systems is the ability to sense th...
research
11/18/2020

Semantic Scene Completion using Local Deep Implicit Functions on LiDAR Data

Semantic scene completion is the task of jointly estimating 3D geometry ...
research
02/10/2021

H3D: Benchmark on Semantic Segmentation of High-Resolution 3D Point Clouds and textured Meshes from UAV LiDAR and Multi-View-Stereo

Automated semantic segmentation and object detection are of great import...
research
09/28/2021

KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3D

For the last few decades, several major subfields of artificial intellig...
research
03/31/2020

PolarNet: An Improved Grid Representation for Online LiDAR Point Clouds Semantic Segmentation

The requirement of fine-grained perception by autonomous driving systems...
research
12/23/2020

Pit30M: A Benchmark for Global Localization in the Age of Self-Driving Cars

We are interested in understanding whether retrieval-based localization ...

Please sign up or login with your details

Forgot password? Click here to reset