ContrastMotion: Self-supervised Scene Motion Learning for Large-Scale LiDAR Point Clouds

04/25/2023
by   Xiangze Jia, et al.
0

In this paper, we propose a novel self-supervised motion estimator for LiDAR-based autonomous driving via BEV representation. Different from usually adopted self-supervised strategies for data-level structure consistency, we predict scene motion via feature-level consistency between pillars in consecutive frames, which can eliminate the effect caused by noise points and view-changing point clouds in dynamic scenes. Specifically, we propose Soft Discriminative Loss that provides the network with more pseudo-supervised signals to learn discriminative and robust features in a contrastive learning manner. We also propose Gated Multi-frame Fusion block that learns valid compensation between point cloud frames automatically to enhance feature extraction. Finally, pillar association is proposed to predict pillar correspondence probabilities based on feature distance, and whereby further predicts scene motion. Extensive experiments show the effectiveness and superiority of our ContrastMotion on both scene flow and motion prediction tasks. The code is available soon.

READ FULL TEXT

page 1

page 7

research
09/27/2022

3D Scene Flow Estimation on Pseudo-LiDAR: Bridging the Gap on Estimating Point Motion

3D scene flow characterizes how the points at the current time flow to t...
research
12/17/2020

Temporal LiDAR Frame Prediction for Autonomous Driving

Anticipating the future in a dynamic scene is critical for many fields s...
research
04/18/2021

Self-Supervised Pillar Motion Learning for Autonomous Driving

Autonomous driving can benefit from motion behavior comprehension when i...
research
05/04/2023

Self-Supervised 3D Scene Flow Estimation Guided by Superpoints

3D scene flow estimation aims to estimate point-wise motions between two...
research
09/28/2021

Self-supervised Point Cloud Prediction Using 3D Spatio-temporal Convolutional Networks

Exploiting past 3D LiDAR scans to predict future point clouds is a promi...
research
08/08/2022

SLiDE: Self-supervised LiDAR De-snowing through Reconstruction Difficulty

LiDAR is widely used to capture accurate 3D outdoor scene structures. Ho...
research
03/01/2021

Scalable Scene Flow from Point Clouds in the Real World

Autonomous vehicles operate in highly dynamic environments necessitating...

Please sign up or login with your details

Forgot password? Click here to reset