A Fusion Approach for Multi-Frame Optical Flow Estimation

10/23/2018
by   Zhile Ren, et al.
3

To date, top-performing optical flow estimation methods only take pairs of consecutive frames into account. While elegant and appealing, the idea of using more than two frames has not yet produced state-of-the-art results. We present a simple, yet effective fusion approach for multi-frame optical flow that benefits from longer-term temporal cues. Our method first warps the optical flow from previous frames to the current, thereby yielding multiple plausible estimates. It then fuses the complementary information carried by these estimates into a new optical flow field. At the time of submission, our method ranks first among published flow methods in the MPI Sintel and KITTI 2015 benchmarks.

READ FULL TEXT

page 4

page 5

page 7

page 8

research
03/15/2023

VideoFlow: Exploiting Temporal Cues for Multi-frame Optical Flow Estimation

We introduce VideoFlow, a novel optical flow estimation framework for vi...
research
04/26/2023

SSTM: Spatiotemporal Recurrent Transformers for Multi-frame Optical Flow Estimation

Inaccurate optical flow estimates in and near occluded regions, and out-...
research
07/31/2023

SAMFlow: Eliminating Any Fragmentation in Optical Flow with Segment Anything Model

Optical flow estimation aims to find the 2D dense motion field between t...
research
11/29/2016

Surveillance Video Parsing with Single Frame Supervision

Surveillance video parsing, which segments the video frames into several...
research
03/26/2021

Challenges for Optical Flow Estimates in Elastography

In this paper, we consider visualization of displacement fields via opti...
research
05/30/2018

Novel Video Prediction for Large-scale Scene using Optical Flow

Making predictions of future frames is a critical challenge in autonomou...
research
01/16/2021

Optical Flow Estimation via Motion Feature Recovery

Optical flow estimation with occlusion or large displacement is a proble...

Please sign up or login with your details

Forgot password? Click here to reset