Implementing Adaptive Separable Convolution for Video Frame Interpolation

09/20/2018
by   Mart Kartašev, et al.
4

As Deep Neural Networks are becoming more popular, much of the attention is being devoted to Computer Vision problems that used to be solved with more traditional approaches. Video frame interpolation is one of such challenges that has seen new research involving various techniques in deep learning. In this paper, we replicate the work of Niklaus et al. on Adaptive Separable Convolution, which claims high quality results on the video frame interpolation task. We apply the same network structure trained on a smaller dataset and experiment with various different loss functions, in order to determine the optimal approach in data-scarce scenarios. The best resulting model is still able to provide visually pleasing videos, although achieving lower evaluation scores.

READ FULL TEXT

page 5

page 6

page 8

research
08/05/2017

Video Frame Interpolation via Adaptive Separable Convolution

Standard video frame interpolation methods first estimate optical flow b...
research
11/02/2020

Revisiting Adaptive Convolutions for Video Frame Interpolation

Video frame interpolation, the synthesis of novel views in time, is an i...
research
11/16/2017

Frame Interpolation with Multi-Scale Deep Loss Functions and Generative Adversarial Networks

Frame interpolation attempts to synthesise intermediate frames given one...
research
10/30/2020

LIFI: Towards Linguistically Informed Frame Interpolation

In this work, we explore a new problem of frame interpolation for speech...
research
07/24/2019

Learning Spatial Transform for Video Frame Interpolation

Video frame interpolation is one of the most challenging tasks in the vi...
research
06/01/2020

Reducing the X-ray radiation exposure frequency in cardio-angiography via deep-learning based video interpolation

Cardiac coronary angiography is a major technology to assist doctors dur...
research
03/19/2016

Learning Image Matching by Simply Watching Video

This work presents an unsupervised learning based approach to the ubiqui...

Please sign up or login with your details

Forgot password? Click here to reset