Occlusion Aware Unsupervised Learning of Optical Flow

11/16/2017
by   Yang Wang, et al.
0

It has been recently shown that a convolutional neural network can learn optical flow estimation with unsupervised learning. However, the performance of the unsupervised methods still has a relatively large gap compared to its supervised counterpart. Occlusion and large motion are some of the major factors that limit the current unsupervised learning of optical flow methods. In this work we introduce a new method which models occlusion explicitly and a new warping way that facilitates the learning of large motion. Our method shows promising results on Flying Chairs, MPI-Sintel and KITTI benchmark datasets. Especially on KITTI dataset where abundant unlabeled samples exist, our unsupervised method outperforms its counterpart trained with supervised learning.

READ FULL TEXT

page 2

page 7

research
05/14/2021

SMURF: Self-Teaching Multi-Frame Unsupervised RAFT with Full-Image Warping

We present SMURF, a method for unsupervised learning of optical flow tha...
research
04/14/2023

Unsupervised Learning Optical Flow in Multi-frame Dynamic Environment Using Temporal Dynamic Modeling

For visual estimation of optical flow, a crucial function for many visio...
research
10/20/2019

Moving Indoor: Unsupervised Video Depth Learning in Challenging Environments

Recently unsupervised learning of depth from videos has made remarkable ...
research
07/15/2022

USegScene: Unsupervised Learning of Depth, Optical Flow and Ego-Motion with Semantic Guidance and Coupled Networks

In this paper we propose USegScene, a framework for semantically guided ...
research
05/07/2018

Learning Optical Flow via Dilated Networks and Occlusion Reasoning

Despite the significant progress that has been made on estimating optica...
research
02/25/2019

DDFlow: Learning Optical Flow with Unlabeled Data Distillation

We present DDFlow, a data distillation approach to learning optical flow...
research
08/20/2016

Back to Basics: Unsupervised Learning of Optical Flow via Brightness Constancy and Motion Smoothness

Recently, convolutional networks (convnets) have proven useful for predi...

Please sign up or login with your details

Forgot password? Click here to reset