PCPNet: An Efficient and Semantic-Enhanced Transformer Network for Point Cloud Prediction

04/16/2023
by   Zhen Luo, et al.
0

The ability to predict future structure features of environments based on past perception information is extremely needed by autonomous vehicles, which helps to make the following decision-making and path planning more reasonable. Recently, point cloud prediction (PCP) is utilized to predict and describe future environmental structures by the point cloud form. In this letter, we propose a novel efficient Transformer-based network to predict the future LiDAR point clouds exploiting the past point cloud sequences. We also design a semantic auxiliary training strategy to make the predicted LiDAR point cloud sequence semantically similar to the ground truth and thus improves the significance of the deployment for more tasks in real-vehicle applications. Our approach is completely self-supervised, which means it does not require any manual labeling and has a solid generalization ability toward different environments. The experimental results show that our method outperforms the state-of-the-art PCP methods on the prediction results and semantic similarity, and has a good real-time performance. Our open-source code and pre-trained models are available at https://github.com/Blurryface0814/PCPNet.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 7

research
09/28/2021

Self-supervised Point Cloud Prediction Using 3D Spatio-temporal Convolutional Networks

Exploiting past 3D LiDAR scans to predict future point clouds is a promi...
research
03/24/2022

AziNorm: Exploiting the Radial Symmetry of Point Cloud for Azimuth-Normalized 3D Perception

Studying the inherent symmetry of data is of great importance in machine...
research
07/07/2022

Masked Surfel Prediction for Self-Supervised Point Cloud Learning

Masked auto-encoding is a popular and effective self-supervised learning...
research
11/13/2022

BTO-RRT: A rapid, optimal, smooth and point cloud-based path planning algorithm

This paper explores a rapid, optimal smooth path-planning algorithm for ...
research
02/03/2023

CVTNet: A Cross-View Transformer Network for Place Recognition Using LiDAR Data

LiDAR-based place recognition (LPR) is one of the most crucial component...
research
03/23/2023

Position-Guided Point Cloud Panoptic Segmentation Transformer

DEtection TRansformer (DETR) started a trend that uses a group of learna...
research
08/11/2022

PointTree: Transformation-Robust Point Cloud Encoder with Relaxed K-D Trees

Being able to learn an effective semantic representation directly on raw...

Please sign up or login with your details

Forgot password? Click here to reset