Occlusions, Motion and Depth Boundaries with a Generic Network for Disparity, Optical Flow or Scene Flow Estimation

08/06/2018
by   Eddy Ilg, et al.
2

Occlusions play an important role in disparity and optical flow estimation, since matching costs are not available in occluded areas and occlusions indicate depth or motion boundaries. Moreover, occlusions are relevant for motion segmentation and scene flow estimation. In this paper, we present an efficient learning-based approach to estimate occlusion areas jointly with disparities or optical flow. The estimated occlusions and motion boundaries clearly improve over the state-of-the-art. Moreover, we present networks with state-of-the-art performance on the popular KITTI benchmark and good generic performance. Making use of the estimated occlusions, we also show improved results on motion segmentation and scene flow estimation.

READ FULL TEXT

page 11

page 12

page 19

page 20

page 23

page 24

page 25

page 26

research
01/15/2018

Combining Stereo Disparity and Optical Flow for Basic Scene Flow

Scene flow is a description of real world motion in 3D that contains mor...
research
03/10/2023

SemARFlow: Injecting Semantics into Unsupervised Optical Flow Estimation for Autonomous Driving

Unsupervised optical flow estimation is especially hard near occlusions ...
research
04/11/2018

Multi-Scale Generalized Plane Match for Optical Flow

Despite recent advances, estimating optical flow remains a challenging p...
research
07/22/2014

Aggregation of local parametric candidates with exemplar-based occlusion handling for optical flow

Handling all together large displacements, motion details and occlusions...
research
05/29/2022

SKFlow: Learning Optical Flow with Super Kernels

Optical flow estimation is a classical yet challenging task in computer ...
research
11/01/2021

Joint Detection of Motion Boundaries and Occlusions

We propose MONet, a convolutional neural network that jointly detects mo...
research
11/05/2018

Continual Occlusions and Optical Flow Estimation

Two optical flow estimation problems are addressed: i) occlusion estimat...

Please sign up or login with your details

Forgot password? Click here to reset