Log In Sign Up

A Fusion Approach for Multi-Frame Optical Flow Estimation

by   Zhile Ren, et al.

To date, top-performing optical flow estimation methods only take pairs of consecutive frames into account. While elegant and appealing, the idea of using more than two frames has not yet produced state-of-the-art results. We present a simple, yet effective fusion approach for multi-frame optical flow that benefits from longer-term temporal cues. Our method first warps the optical flow from previous frames to the current, thereby yielding multiple plausible estimates. It then fuses the complementary information carried by these estimates into a new optical flow field. At the time of submission, our method ranks first among published flow methods in the MPI Sintel and KITTI 2015 benchmarks.


page 4

page 5

page 7

page 8


STaRFlow: A SpatioTemporal Recurrent Cell for Lightweight Multi-Frame Optical Flow Estimation

We present a new lightweight CNN-based algorithm for multi-frame optical...

Surveillance Video Parsing with Single Frame Supervision

Surveillance video parsing, which segments the video frames into several...

Challenges for Optical Flow Estimates in Elastography

In this paper, we consider visualization of displacement fields via opti...

Novel Video Prediction for Large-scale Scene using Optical Flow

Making predictions of future frames is a critical challenge in autonomou...

Optical Flow Estimation via Motion Feature Recovery

Optical flow estimation with occlusion or large displacement is a proble...

Particle Videos Revisited: Tracking Through Occlusions Using Point Trajectories

Tracking pixels in videos is typically studied as an optical flow estima...

ScopeFlow: Dynamic Scene Scoping for Optical Flow

We propose to modify the common training protocols of optical flow, lead...