A Benchmark for LiDAR-based Panoptic Segmentation based on KITTI

by   Jens Behley, et al.

Panoptic segmentation is the recently introduced task that tackles semantic segmentation and instance segmentation jointly. In this paper, we present an extension of SemanticKITTI, which is a large-scale dataset providing dense point-wise semantic labels for all sequences of the KITTI Odometry Benchmark, for training and evaluation of laser-based panoptic segmentation. We provide the data and discuss the processing steps needed to enrich a given semantic annotation with temporally consistent instance information, i.e., instance information that supplements the semantic labels and identifies the same instance over sequences of LiDAR point clouds. Additionally, we present two strong baselines that combine state-of-the-art LiDAR-based semantic segmentation approaches with a state-of-the-art detector enriching the segmentation with instance information and that allow other researchers to compare their approaches against. We hope that our extension of SemanticKITTI with strong baselines enables the creation of novel algorithms for LiDAR-based panoptic segmentation as much as it has for the original semantic segmentation and semantic scene completion tasks. Data, code, and an online evaluation using a hidden test set will be published on http://semantic-kitti.org.


page 1

page 3


A Dataset for Semantic Segmentation of Point Cloud Sequences

Semantic scene understanding is important for various applications. In p...

KITTI-CARLA: a KITTI-like dataset generated by CARLA Simulator

KITTI-CARLA is a dataset built from the CARLA v0.9.10 simulator using a ...

DeepTemporalSeg: Temporally Consistent Semantic Segmentation of 3D LiDAR Scans

Understanding the semantic characteristics of the environment is a key e...

4D Panoptic LiDAR Segmentation

Temporal semantic scene understanding is critical for self-driving cars ...

Learning to Optimally Segment Point Clouds

We focus on the problem of class-agnostic instance segmentation of LiDAR...

Panoster: End-to-end Panoptic Segmentation of LiDAR Point Clouds

Panoptic segmentation has recently unified semantic and instance segment...

MASS: Multi-Attentional Semantic Segmentation of LiDAR Data for Dense Top-View Understanding

At the heart of all automated driving systems is the ability to sense th...

Please sign up or login with your details

Forgot password? Click here to reset