DeepAI AI Chat
Log In Sign Up

InsMOS: Instance-Aware Moving Object Segmentation in LiDAR Data

03/07/2023
by   Neng Wang, et al.
0

Identifying moving objects is a crucial capability for autonomous navigation, consistent map generation, and future trajectory prediction of objects. In this paper, we propose a novel network that addresses the challenge of segmenting moving objects in 3D LiDAR scans. Our approach not only predicts point-wise moving labels but also detects instance information of main traffic participants. Such a design helps determine which instances are actually moving and which ones are temporarily static in the current scene. Our method exploits a sequence of point clouds as input and quantifies them into 4D voxels. We use 4D sparse convolutions to extract motion features from the 4D voxels and inject them into the current scan. Then, we extract spatio-temporal features from the current scan for instance detection and feature fusion. Finally, we design an upsample fusion module to output point-wise labels by fusing the spatio-temporal features and predicted instance information. We evaluated our approach on the LiDAR-MOS benchmark based on SemanticKITTI and achieved better moving object segmentation performance compared to state-of-the-art methods, demonstrating the effectiveness of our approach in integrating instance information for moving object segmentation. Furthermore, our method shows superior performance on the Apollo dataset with a pre-trained model on SemanticKITTI, indicating that our method generalizes well in different scenes.The code and pre-trained models of our method will be released at https://github.com/nubot-nudt/InsMOS.

READ FULL TEXT

page 1

page 3

page 6

page 7

06/08/2022

Receding Moving Object Segmentation in 3D LiDAR Data Using Sparse 4D Convolutions

A key challenge for autonomous vehicles is to navigate in unseen dynamic...
09/29/2016

Robust Moving Objects Detection in Lidar Data Exploiting Visual Cues

Detecting moving objects in dynamic scenes from sequences of lidar scans...
05/06/2022

Semantics-Guided Moving Object Segmentation with 3D LiDAR

Moving object segmentation (MOS) is a task to distinguish moving objects...
04/29/2020

DR-SPAAM: A Spatial-Attention and Auto-regressive Model for Person Detection in 2D Range Data

Detecting persons using a 2D LiDAR is a challenging task due to the low ...
09/29/2022

4D-StOP: Panoptic Segmentation of 4D LiDAR using Spatio-temporal Object Proposal Generation and Aggregation

In this work, we present a new paradigm, called 4D-StOP, to tackle the t...
02/22/2021

Deep Learning for Robust Motion Segmentation with Non-Static Cameras

This work proposes a new end-to-end DCNN based approach for motion segme...

Code Repositories

InsMOS

InsMOS: Instance-Aware Moving Object Segmentation in LiDAR Data


view repo