Asymmetric Bilateral Motion Estimation for Video Frame Interpolation

08/15/2021
by   Junheum Park, et al.
0

We propose a novel video frame interpolation algorithm based on asymmetric bilateral motion estimation (ABME), which synthesizes an intermediate frame between two input frames. First, we predict symmetric bilateral motion fields to interpolate an anchor frame. Second, we estimate asymmetric bilateral motions fields from the anchor frame to the input frames. Third, we use the asymmetric fields to warp the input frames backward and reconstruct the intermediate frame. Last, to refine the intermediate frame, we develop a new synthesis network that generates a set of dynamic filters and a residual frame using local and global information. Experimental results show that the proposed algorithm achieves excellent performance on various datasets. The source codes and pretrained models are available at https://github.com/JunHeum/ABME.

READ FULL TEXT

page 1

page 7

page 8

research
04/05/2023

BiFormer: Learning Bilateral Motion Estimation via Bilateral Transformer for 4K Video Frame Interpolation

A novel 4K video frame interpolator based on bilateral transformer (BiFo...
research
04/26/2023

Video Frame Interpolation with Densely Queried Bilateral Correlation

Video Frame Interpolation (VFI) aims to synthesize non-existent intermed...
research
06/17/2022

Enhanced Bi-directional Motion Estimation for Video Frame Interpolation

We present a novel simple yet effective algorithm for motion-based video...
research
05/27/2021

FastRIFE: Optimization of Real-Time Intermediate Flow Estimation for Video Frame Interpolation

The problem of video inter-frame interpolation is an essential task in t...
research
03/18/2021

CDFI: Compression-Driven Network Design for Frame Interpolation

DNN-based frame interpolation–that generates the intermediate frames giv...
research
11/26/2019

Motion-Based Generator Model: Unsupervised Disentanglement of Appearance, Trackable and Intrackable Motions in Dynamic Patterns

Dynamic patterns are characterized by complex spatial and motion pattern...
research
11/22/2022

Flow Guidance Deformable Compensation Network for Video Frame Interpolation

Motion-based video frame interpolation (VFI) methods have made remarkabl...

Please sign up or login with your details

Forgot password? Click here to reset