FESTA: Flow Estimation via Spatial-Temporal Attention for Scene Point Clouds

04/01/2021
by   Haiyan Wang, et al.
0

Scene flow depicts the dynamics of a 3D scene, which is critical for various applications such as autonomous driving, robot navigation, AR/VR, etc. Conventionally, scene flow is estimated from dense/regular RGB video frames. With the development of depth-sensing technologies, precise 3D measurements are available via point clouds which have sparked new research in 3D scene flow. Nevertheless, it remains challenging to extract scene flow from point clouds due to the sparsity and irregularity in typical point cloud sampling patterns. One major issue related to irregular sampling is identified as the randomness during point set abstraction/feature extraction – an elementary process in many flow estimation scenarios. A novel Spatial Abstraction with Attention (SA^2) layer is accordingly proposed to alleviate the unstable abstraction problem. Moreover, a Temporal Abstraction with Attention (TA^2) layer is proposed to rectify attention in temporal domain, leading to benefits with motions scaled in a larger range. Extensive analysis and experiments verified the motivation and significant performance gains of our method, dubbed as Flow Estimation via Spatial-Temporal Attention (FESTA), when compared to several state-of-the-art benchmarks of scene flow estimation.

READ FULL TEXT
research
09/10/2021

Residual 3D Scene Flow Learning with Context-Aware Feature Extraction

Scene flow estimation is the task to predict the point-wise 3D displacem...
research
10/12/2020

Hierarchical Attention Learning of Scene Flow in 3D Point Clouds

Scene flow represents the 3D motion of every point in the dynamic enviro...
research
11/30/2020

Occlusion Guided Scene Flow Estimation on 3D Point Clouds

3D scene flow estimation is a vital tool in perceiving our environment g...
research
05/23/2022

RCP: Recurrent Closest Point for Scene Flow Estimation on 3D Point Clouds

3D motion estimation including scene flow and point cloud registration h...
research
04/01/2022

RMS-FlowNet: Efficient and Robust Multi-Scale Scene Flow Estimation for Large-Scale Point Clouds

The proposed RMS-FlowNet is a novel end-to-end learning-based architectu...
research
05/17/2022

UnPWC-SVDLO: Multi-SVD on PointPWC for Unsupervised Lidar Odometry

High-precision lidar odomety is an essential part of autonomous driving....
research
08/08/2023

DELFlow: Dense Efficient Learning of Scene Flow for Large-Scale Point Clouds

Point clouds are naturally sparse, while image pixels are dense. The inc...

Please sign up or login with your details

Forgot password? Click here to reset