DeepAI
Log In Sign Up

A Fusion Approach for Multi-Frame Optical Flow Estimation

10/23/2018
by   Zhile Ren, et al.
3

To date, top-performing optical flow estimation methods only take pairs of consecutive frames into account. While elegant and appealing, the idea of using more than two frames has not yet produced state-of-the-art results. We present a simple, yet effective fusion approach for multi-frame optical flow that benefits from longer-term temporal cues. Our method first warps the optical flow from previous frames to the current, thereby yielding multiple plausible estimates. It then fuses the complementary information carried by these estimates into a new optical flow field. At the time of submission, our method ranks first among published flow methods in the MPI Sintel and KITTI 2015 benchmarks.

READ FULL TEXT

page 4

page 5

page 7

page 8

07/10/2020

STaRFlow: A SpatioTemporal Recurrent Cell for Lightweight Multi-Frame Optical Flow Estimation

We present a new lightweight CNN-based algorithm for multi-frame optical...
11/29/2016

Surveillance Video Parsing with Single Frame Supervision

Surveillance video parsing, which segments the video frames into several...
03/26/2021

Challenges for Optical Flow Estimates in Elastography

In this paper, we consider visualization of displacement fields via opti...
05/30/2018

Novel Video Prediction for Large-scale Scene using Optical Flow

Making predictions of future frames is a critical challenge in autonomou...
01/16/2021

Optical Flow Estimation via Motion Feature Recovery

Optical flow estimation with occlusion or large displacement is a proble...
04/08/2022

Particle Videos Revisited: Tracking Through Occlusions Using Point Trajectories

Tracking pixels in videos is typically studied as an optical flow estima...
02/25/2020

ScopeFlow: Dynamic Scene Scoping for Optical Flow

We propose to modify the common training protocols of optical flow, lead...