SceneFlowFields: Dense Interpolation of Sparse Scene Flow Correspondences

10/27/2017
by   René Schuster, et al.
0

While most scene flow methods use either variational optimization or a strong rigid motion assumption, we show for the first time that scene flow can also be estimated by dense interpolation of sparse matches. To this end, we find sparse matches across two stereo image pairs that are detected without any prior regularization and perform dense interpolation preserving geometric and motion boundaries by using edge information. A few iterations of variational energy minimization are performed to refine our results, which are thoroughly evaluated on the KITTI benchmark and additionally compared to state-of-the-art on MPI Sintel. For application in an automotive context, we further show that an optional ego-motion model helps to boost performance and blends smoothly into our approach to produce a segmentation of the scene into static and dynamic parts.

READ FULL TEXT

page 1

page 4

page 5

page 6

page 8

research
01/12/2015

EpicFlow: Edge-Preserving Interpolation of Correspondences for Optical Flow

We propose a novel approach for optical flow estimation , targeted at la...
research
02/26/2019

SceneFlowFields++: Multi-frame Matching, Visibility Prediction, and Robust Interpolation for Scene Flow Estimation

State-of-the-art scene flow algorithms pursue the conflicting targets of...
research
10/31/2019

LiDAR-Flow: Dense Scene Flow Estimation from Sparse LiDAR and Stereo Images

We propose a new approach called LiDAR-Flow to robustly estimate a dense...
research
07/27/2016

A Continuous Optimization Approach for Efficient and Accurate Scene Flow

We propose a continuous optimization method for solving dense 3D scene f...
research
09/07/2016

Dense Motion Estimation for Smoke

Motion estimation for highly dynamic phenomena such as smoke is an open ...
research
08/21/2020

SSGP: Sparse Spatial Guided Propagation for Robust and Generic Interpolation

Interpolation of sparse pixel information towards a dense target resolut...
research
06/24/2022

Motion Estimation for Large Displacements and Deformations

Large displacement optical flow is an integral part of many computer vis...

Please sign up or login with your details

Forgot password? Click here to reset