Efficient Spatial-Temporal Information Fusion for LiDAR-Based 3D Moving Object Segmentation

07/05/2022
by   Jiadai Sun, et al.
26

Accurate moving object segmentation is an essential task for autonomous driving. It can provide effective information for many downstream tasks, such as collision avoidance, path planning, and static map construction. How to effectively exploit the spatial-temporal information is a critical question for 3D LiDAR moving object segmentation (LiDAR-MOS). In this work, we propose a novel deep neural network exploiting both spatial-temporal information and different representation modalities of LiDAR scans to improve LiDAR-MOS performance. Specifically, we first use a range image-based dual-branch structure to separately deal with spatial and temporal information that can be obtained from sequential LiDAR scans, and later combine them using motion-guided attention modules. We also use a point refinement module via 3D sparse convolution to fuse the information from both LiDAR range image and point cloud representations and reduce the artifacts on the borders of the objects. We verify the effectiveness of our proposed approach on the LiDAR-MOS benchmark of SemanticKITTI. Our method outperforms the state-of-the-art methods significantly in terms of LiDAR-MOS IoU. Benefiting from the devised coarse-to-fine architecture, our method operates online at sensor frame rate. The implementation of our method is available as open source at: https://github.com/haomo-ai/MotionSeg3D.

READ FULL TEXT

page 1

page 3

page 4

page 7

research
07/18/2023

3D-SeqMOS: A Novel Sequential 3D Moving Object Segmentation in Autonomous Driving

For the SLAM system in robotics and autonomous driving, the accuracy of ...
research
05/12/2023

MotionBEV: Attention-Aware Online LiDAR Moving Object Segmentation with Bird's Eye View based Appearance and Motion Features

Identifying moving objects is an essential capability for autonomous sys...
research
02/27/2022

Meta-RangeSeg: LiDAR Sequence Semantic Segmentation Using Multiple Feature Aggregation

LiDAR sensor is essential to the perception system in autonomous vehicle...
research
04/29/2020

DR-SPAAM: A Spatial-Attention and Auto-regressive Model for Person Detection in 2D Range Data

Detecting persons using a 2D LiDAR is a challenging task due to the low ...
research
09/28/2021

Self-supervised Point Cloud Prediction Using 3D Spatio-temporal Convolutional Networks

Exploiting past 3D LiDAR scans to predict future point clouds is a promi...
research
07/05/2023

Traversability Analysis for Autonomous Driving in Complex Environment: A LiDAR-based Terrain Modeling Approach

For autonomous driving, traversability analysis is one of the most basic...
research
07/04/2023

SUIT: Learning Significance-guided Information for 3D Temporal Detection

3D object detection from LiDAR point cloud is of critical importance for...

Please sign up or login with your details

Forgot password? Click here to reset