Exploiting Implicit Rigidity Constraints via Weight-Sharing Aggregation for Scene Flow Estimation from Point Clouds

03/04/2023
by   Yun Wang, et al.
0

Scene flow estimation, which predicts the 3D motion of scene points from point clouds, is a core task in autonomous driving and many other 3D vision applications. Existing methods either suffer from structure distortion due to ignorance of rigid motion consistency or require explicit pose estimation and 3D object segmentation. Errors of estimated poses and segmented objects would yield inaccurate rigidity constraints and in turn mislead scene flow estimation. In this paper, we propose a novel weight-sharing aggregation (WSA) method for feature and scene flow up-sampling. WSA does not rely on estimated poses and segmented objects, and can implicitly enforce rigidity constraints to avoid structure distortion in scene flow estimation. To further exploit geometric information and preserve local structure, we design a moving cost volume aim to keep the local region invariance. We modify the PointPWC-Net and integrate the proposed WSA and moving cost volume into the enhanced PointPWC-Net to derive an end-to-end scene flow estimation network, called WSAFlowNet. Extensive experimental results on the FlyingThings3D [19] and KITTI [21]datasets demonstrate that our WSAFlowNet achieves the state-ofthe-art performance and outperforms previous methods by a large margin. We will release the source code at https://github.com/wangyunlhr/WSAFlowNet.git

READ FULL TEXT
research
07/19/2022

What Matters for 3D Scene Flow Network

3D scene flow estimation from point clouds is a low-level 3D motion perc...
research
05/17/2021

HCRF-Flow: Scene Flow from Point Clouds with Continuous High-order CRFs and Position-aware Flow Embedding

Scene flow in 3D point clouds plays an important role in understanding d...
research
12/03/2019

FlowNet3D++: Geometric Losses For Deep Scene Flow Estimation

We present FlowNet3D++, a deep scene flow estimation network. Inspired b...
research
08/21/2022

Objects Can Move: 3D Change Detection by Geometric Transformation Constistency

AR/VR applications and robots need to know when the scene has changed. A...
research
02/17/2021

Weakly Supervised Learning of Rigid 3D Scene Flow

We propose a data-driven scene flow estimation algorithm exploiting the ...
research
11/27/2019

PointPWC-Net: A Coarse-to-Fine Network for Supervised and Self-Supervised Scene Flow Estimation on 3D Point Clouds

We propose a novel end-to-end deep scene flow model, called PointPWC-Net...
research
06/06/2018

PointFlowNet: Learning Representations for 3D Scene Flow Estimation from Point Clouds

Despite significant progress in image-based 3D scene flow estimation, th...

Please sign up or login with your details

Forgot password? Click here to reset