PatchBatch: a Batch Augmented Loss for Optical Flow

12/06/2015
by   David Gadot, et al.
0

We propose a new pipeline for optical flow computation, based on Deep Learning techniques. We suggest using a Siamese CNN to independently, and in parallel, compute the descriptors of both images. The learned descriptors are then compared efficiently using the L2 norm and do not require network processing of patch pairs. The success of the method is based on an innovative loss function that computes higher moments of the loss distributions for each training batch. Combined with an Approximate Nearest Neighbor patch matching method and a flow interpolation technique, state of the art performance is obtained on the most challenging and competitive optical flow benchmarks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/29/2016

InterpoNet, A brain inspired neural network for optical flow dense interpolation

Sparse-to-dense interpolation for optical flow is a fundamental phase in...
research
07/27/2016

CNN-based Patch Matching for Optical Flow with Thresholded Hinge Embedding Loss

Learning based approaches have not yet achieved their full potential in ...
research
07/20/2017

Scalable Full Flow with Learned Binary Descriptors

We propose a method for large displacement optical flow in which local m...
research
03/07/2017

Optical Flow Fields: Dense Correspondence Fields for Highly Accurate Large Displacement Optical Flow Estimation

Modern large displacement optical flow algorithms usually use an initial...
research
12/02/2021

Generalized Closed-form Formulae for Feature-based Subpixel Alignment in Patch-based Matching

Cost-based image patch matching is at the core of various techniques in ...
research
08/07/2022

Learning Omnidirectional Flow in 360-degree Video via Siamese Representation

Optical flow estimation in omnidirectional videos faces two significant ...
research
04/26/2016

Learning by tracking: Siamese CNN for robust target association

This paper introduces a novel approach to the task of data association w...

Please sign up or login with your details

Forgot password? Click here to reset