Occlusion Guided Scene Flow Estimation on 3D Point Clouds

11/30/2020
by   Bojun Ouyang, et al.
0

3D scene flow estimation is a vital tool in perceiving our environment given depth or range sensors. Unlike optical flow, the data is usually sparse and in most cases partially occluded in between two temporal samplings. Here we propose a new scene flow architecture called OGSF-Net which tightly couples the learning for both flow and occlusions between frames. Their coupled symbiosis results in a more accurate prediction of flow in space. Unlike a traditional multi-action network, our unified approach is fused throughout the network, boosting performances for both occlusion detection and flow estimation. Our architecture is the first to gauge the occlusion in 3D scene flow estimation on point clouds. In key datasets such as Flyingthings3D and KITTI, we achieve the state-of-the-art results.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/07/2022

GMA3D: Local-Global Attention Learning to Estimate Occluded Motions of Scene Flow

Scene flow is the collection of each point motion information in the 3D ...
research
04/10/2021

Occlusion Guided Self-supervised Scene Flow Estimation on 3D Point Clouds

Understanding the flow in 3D space of sparsely sampled points between tw...
research
11/05/2018

Continual Occlusions and Optical Flow Estimation

Two optical flow estimation problems are addressed: i) occlusion estimat...
research
04/01/2021

FESTA: Flow Estimation via Spatial-Temporal Attention for Scene Point Clouds

Scene flow depicts the dynamics of a 3D scene, which is critical for var...
research
04/18/2023

Fast Neural Scene Flow

Scene flow is an important problem as it provides low-level motion cues ...
research
05/27/2023

GMSF: Global Matching Scene Flow

We tackle the task of scene flow estimation from point clouds. Given a s...
research
11/20/2021

CamLiFlow: Bidirectional Camera-LiDAR Fusion for Joint Optical Flow and Scene Flow Estimation

In this paper, we study the problem of jointly estimating the optical fl...

Please sign up or login with your details

Forgot password? Click here to reset