Hierarchical Attention Learning of Scene Flow in 3D Point Clouds

10/12/2020
by   Guangming Wang, et al.
1

Scene flow represents the 3D motion of every point in the dynamic environments. Like the optical flow that represents the motion of pixels in 2D images, 3D motion representation of scene flow benefits many applications, such as autonomous driving and service robot. This paper studies the problem of scene flow estimation from two consecutive 3D point clouds. In this paper, a novel hierarchical neural network with double attention is proposed for learning the correlation of point features in adjacent frames and refining scene flow from coarse to fine layer by layer. The proposed network has a new more-for-less hierarchical architecture. The more-for-less means that the number of input points is greater than the number of output points for scene flow estimation, which brings more input information and balances the precision and resource consumption. In this hierarchical architecture, scene flow of different levels is generated and supervised respectively. A novel attentive embedding module is introduced to aggregate the features of adjacent points using a double attention method in a patch-to-patch manner. The proper layers for flow embedding and flow supervision are carefully considered in our network designment. Experiments show that the proposed network outperforms the state-of-the-art performance of 3D scene flow estimation on the FlyingThings3D and KITTI Scene Flow 2015 datasets. We also apply the proposed network to realistic LiDAR odometry task, which is an key problem in autonomous driving. The experiment results demonstrate that our proposed network can outperform the ICP-based method and shows the good practical application ability.

READ FULL TEXT

page 1

page 4

page 6

page 13

research
09/10/2021

Residual 3D Scene Flow Learning with Context-Aware Feature Extraction

Scene flow estimation is the task to predict the point-wise 3D displacem...
research
11/01/2021

Neural Scene Flow Prior

Before the deep learning revolution, many perception algorithms were bas...
research
04/01/2021

FESTA: Flow Estimation via Spatial-Temporal Attention for Scene Point Clouds

Scene flow depicts the dynamics of a 3D scene, which is critical for var...
research
05/17/2022

UnPWC-SVDLO: Multi-SVD on PointPWC for Unsupervised Lidar Odometry

High-precision lidar odomety is an essential part of autonomous driving....
research
09/11/2022

Unsupervised Learning of 3D Scene Flow with 3D Odometry Assistance

Scene flow represents the 3D motion of each point in the scene, which ex...
research
10/07/2022

GMA3D: Local-Global Attention Learning to Estimate Occluded Motions of Scene Flow

Scene flow is the collection of each point motion information in the 3D ...
research
07/19/2022

What Matters for 3D Scene Flow Network

3D scene flow estimation from point clouds is a low-level 3D motion perc...

Please sign up or login with your details

Forgot password? Click here to reset