PV-RAFT: Point-Voxel Correlation Fields for Scene Flow Estimation of Point Clouds

by   Yi Wei, et al.

In this paper, we propose Point-Voxel Recurrent All-Pairs Field Transforms (PV-RAFT) to estimate scene flow from point clouds. All-pairs correlations play important roles in scene flow estimation task. However, since point clouds are irregular and unordered, it is challenging to efficiently extract features from all-pairs fields in 3D space. To tackle this problem, we present point-voxel correlation fields, which captures both local and long-range dependencies of point pairs. To capture point-based correlations, we adopt K-Nearest Neighbors search that preserves fine-grained information in the local region. By voxelizing point clouds in a multi-scale manner, a pyramid correlation voxels are constructed to model long-range correspondences. Integrating two types of correlations, our PV-RAFT makes use of all-pairs relations to handle both small and large displacements. We evaluate the proposed method on both synthetic dataset FlyingThings3D and real scenes dataset KITTI. Experimental results show that PV-RAFT surpasses state-of-the-art methods by remarkable margins.


page 7

page 8


Multi Point-Voxel Convolution (MPVConv) for Deep Learning on Point Clouds

The existing 3D deep learning methods adopt either individual point-base...

Real-time Rail Recognition Based on 3D Point Clouds

Accurate rail location is a crucial part in the railway support driving ...

RMS-FlowNet: Efficient and Robust Multi-Scale Scene Flow Estimation for Large-Scale Point Clouds

The proposed RMS-FlowNet is a novel end-to-end learning-based architectu...

GraVoS: Gradient based Voxel Selection for 3D Detection

3D object detection within large 3D scenes is challenging not only due t...

SEGCloud: Semantic Segmentation of 3D Point Clouds

3D semantic scene labeling is fundamental to agents operating in the rea...

Not All Voxels Are Equal: Semantic Scene Completion from the Point-Voxel Perspective

We revisit Semantic Scene Completion (SSC), a useful task to predict the...

Residual 3D Scene Flow Learning with Context-Aware Feature Extraction

Scene flow estimation is the task to predict the point-wise 3D displacem...

Code Repositories


[CVPR 2021] PV-RAFT: Point-Voxel Correlation Fields for Scene Flow Estimation of Point Clouds

view repo