Video Interpolation by Event-driven Anisotropic Adjustment of Optical Flow

08/19/2022
by   Song Wu, et al.
0

Video frame interpolation is a challenging task due to the ever-changing real-world scene. Previous methods often calculate the bi-directional optical flows and then predict the intermediate optical flows under the linear motion assumptions, leading to isotropic intermediate flow generation. Follow-up research obtained anisotropic adjustment through estimated higher-order motion information with extra frames. Based on the motion assumptions, their methods are hard to model the complicated motion in real scenes. In this paper, we propose an end-to-end training method A^2OF for video frame interpolation with event-driven Anisotropic Adjustment of Optical Flows. Specifically, we use events to generate optical flow distribution masks for the intermediate optical flow, which can model the complicated motion between two frames. Our proposed method outperforms the previous methods in video frame interpolation, taking supervised event-based video interpolation to a higher stage.

READ FULL TEXT

page 2

page 11

page 14

research
05/17/2023

IDO-VFI: Identifying Dynamics via Optical Flow Guidance for Video Frame Interpolation with Events

Video frame interpolation aims to generate high-quality intermediate fra...
research
06/22/2022

Optical Flow Regularization of Implicit Neural Representations for Video Frame Interpolation

Recent works have shown the ability of Implicit Neural Representations (...
research
07/24/2023

Revisiting Event-based Video Frame Interpolation

Dynamic vision sensors or event cameras provide rich complementary infor...
research
09/27/2022

Frame Interpolation for Dynamic Scenes with Implicit Flow Encoding

In this paper, we propose an algorithm to interpolate between a pair of ...
research
05/11/2021

Video Frame Interpolation via Structure-Motion based Iterative Fusion

Video Frame Interpolation synthesizes non-existent images between adjace...
research
03/17/2021

The Invertible U-Net for Optical-Flow-free Video Interframe Generation

Video frame interpolation is the task of creating an interface between t...
research
03/15/2023

VideoFlow: Exploiting Temporal Cues for Multi-frame Optical Flow Estimation

We introduce VideoFlow, a novel optical flow estimation framework for vi...

Please sign up or login with your details

Forgot password? Click here to reset