Iterative Residual Refinement for Joint Optical Flow and Occlusion Estimation

04/10/2019
by   Junhwa Hur, et al.
0

Deep learning approaches to optical flow estimation have seen rapid progress over the recent years. One common trait of many networks is that they refine an initial flow estimate either through multiple stages or across the levels of a coarse-to-fine representation. While leading to more accurate results, the downside of this is an increased number of parameters. Taking inspiration from both classical energy minimization approaches as well as residual networks, we propose an iterative residual refinement (IRR) scheme based on weight sharing that can be combined with several backbone networks. It reduces the number of parameters, improves the accuracy, or even achieves both. Moreover, we show that integrating occlusion prediction and bi-directional flow estimation into our IRR scheme can further boost the accuracy. Our full network achieves state-of-the-art results for both optical flow and occlusion estimation across several standard datasets.

READ FULL TEXT

page 2

page 4

page 5

page 7

page 11

page 13

page 14

page 15

research
07/23/2021

Detail Preserving Residual Feature Pyramid Modules for Optical Flow

Feature pyramids and iterative refinement have recently led to great pro...
research
05/07/2018

Learning Optical Flow via Dilated Networks and Occlusion Reasoning

Despite the significant progress that has been made on estimating optica...
research
08/22/2018

Joint Coarse-And-Fine Reasoning for Deep Optical Flow

We propose a novel representation for dense pixel-wise estimation tasks ...
research
05/28/2022

DeepRM: Deep Recurrent Matching for 6D Pose Refinement

Precise 6D pose estimation of rigid objects from RGB images is a critica...
research
04/06/2020

Optical Flow Estimation in the Deep Learning Age

Akin to many subareas of computer vision, the recent advances in deep le...
research
07/10/2020

STaRFlow: A SpatioTemporal Recurrent Cell for Lightweight Multi-Frame Optical Flow Estimation

We present a new lightweight CNN-based algorithm for multi-frame optical...
research
07/21/2022

On an Edge-Preserving Variational Model for Optical Flow Estimation

It is well known that classical formulations resembling the Horn and Sch...

Please sign up or login with your details

Forgot password? Click here to reset