Quadratic video interpolation

11/02/2019
by   Xiangyu Xu, et al.
5

Video interpolation is an important problem in computer vision, which helps overcome the temporal limitation of camera sensors. Existing video interpolation methods usually assume uniform motion between consecutive frames and use linear models for interpolation, which cannot well approximate the complex motion in the real world. To address these issues, we propose a quadratic video interpolation method which exploits the acceleration information in videos. This method allows prediction with curvilinear trajectory and variable velocity, and generates more accurate interpolation results. For high-quality frame synthesis, we develop a flow reversal layer to estimate flow fields starting from the unknown target frame to the source frame. In addition, we present techniques for flow refinement. Extensive experiments demonstrate that our approach performs favorably against the existing linear models on a wide variety of video datasets.

READ FULL TEXT

page 7

page 8

page 9

research
12/02/2021

Video Frame Interpolation without Temporal Priors

Video frame interpolation, which aims to synthesize non-exist intermedia...
research
09/10/2020

Enhanced Quadratic Video Interpolation

With the prosperity of digital video industry, video frame interpolation...
research
07/31/2019

Video Stitching for Linear Camera Arrays

Despite the long history of image and video stitching research, existing...
research
07/25/2018

Flow-Grounded Spatial-Temporal Video Prediction from Still Images

Existing video prediction methods mainly rely on observing multiple hist...
research
10/30/2020

LIFI: Towards Linguistically Informed Frame Interpolation

In this work, we explore a new problem of frame interpolation for speech...
research
01/27/2022

Non-linear Motion Estimation for Video Frame Interpolation using Space-time Convolutions

Video frame interpolation aims to synthesize one or multiple frames betw...
research
03/19/2016

Learning Image Matching by Simply Watching Video

This work presents an unsupervised learning based approach to the ubiqui...

Please sign up or login with your details

Forgot password? Click here to reset