MoNet: Motion-based Point Cloud Prediction Network

11/21/2020
by   Fan Lu, et al.
0

Predicting the future can significantly improve the safety of intelligent vehicles, which is a key component in autonomous driving. 3D point clouds accurately model 3D information of surrounding environment and are crucial for intelligent vehicles to perceive the scene. Therefore, prediction of 3D point clouds has great significance for intelligent vehicles, which can be utilized for numerous further applications. However, due to point clouds are unordered and unstructured, point cloud prediction is challenging and has not been deeply explored in current literature. In this paper, we propose a novel motion-based neural network named MoNet. The key idea of the proposed MoNet is to integrate motion features between two consecutive point clouds into the prediction pipeline. The introduction of motion features enables the model to more accurately capture the variations of motion information across frames and thus make better predictions for future motion. In addition, content features are introduced to model the spatial content of individual point clouds. A recurrent neural network named MotionRNN is proposed to capture the temporal correlations of both features. Besides, we propose an attention-based motion align module to address the problem of missing motion features in the inference pipeline. Extensive experiments on two large scale outdoor LiDAR datasets demonstrate the performance of the proposed MoNet. Moreover, we perform experiments on applications using the predicted point clouds and the results indicate the great application potential of the proposed method.

READ FULL TEXT
research
04/25/2022

4DAC: Learning Attribute Compression for Dynamic Point Clouds

With the development of the 3D data acquisition facilities, the increasi...
research
05/04/2023

APR: Online Distant Point Cloud Registration Through Aggregated Point Cloud Reconstruction

For many driving safety applications, it is of great importance to accur...
research
12/28/2022

Circular Accessible Depth: A Robust Traversability Representation for UGV Navigation

In this paper, we present the Circular Accessible Depth (CAD), a robust ...
research
12/01/2021

Point Cloud Segmentation Using Sparse Temporal Local Attention

Point clouds are a key modality used for perception in autonomous vehicl...
research
11/18/2022

LiSnowNet: Real-time Snow Removal for LiDAR Point Cloud

LiDARs have been widely adopted to modern self-driving vehicles, providi...
research
04/16/2023

Obstacle-Transformer: A Trajectory Prediction Network Based on Surrounding Trajectories

Recurrent Neural Network, Long Short-Term Memory, and Transformer have m...
research
06/26/2019

Large-scale 3D point cloud representations via graph inception networks with applications to autonomous driving

We present a novel graph-neural-network-based system to effectively repr...

Please sign up or login with your details

Forgot password? Click here to reset