Revisiting Adaptive Convolutions for Video Frame Interpolation

11/02/2020
by   Simon Niklaus, et al.
0

Video frame interpolation, the synthesis of novel views in time, is an increasingly popular research direction with many new papers further advancing the state of the art. But as each new method comes with a host of variables that affect the interpolation quality, it can be hard to tell what is actually important for this task. In this work, we show, somewhat surprisingly, that it is possible to achieve near state-of-the-art results with an older, simpler approach, namely adaptive separable convolutions, by a subtle set of low level improvements. In doing so, we propose a number of intuitive but effective techniques to improve the frame interpolation quality, which also have the potential to other related applications of adaptive convolutions such as burst image denoising, joint image filtering, or video prediction.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 4

page 7

09/20/2018

Implementing Adaptive Separable Convolution for Video Frame Interpolation

As Deep Neural Networks are becoming more popular, much of the attention...
03/22/2017

Video Frame Interpolation via Adaptive Convolution

Video frame interpolation typically involves two steps: motion estimatio...
09/05/2019

Deep Iterative Frame Interpolation for Full-frame Video Stabilization

Video stabilization is a fundamental and important technique for higher ...
06/01/2021

RAI-Net: Range-Adaptive LiDAR Point Cloud Frame Interpolation Network

LiDAR point cloud frame interpolation, which synthesizes the intermediat...
07/23/2020

All at Once: Temporally Adaptive Multi-Frame Interpolation with Advanced Motion Modeling

Recent advances in high refresh rate displays as well as the increased i...
07/10/2020

Conditioned Time-Dilated Convolutions for Sound Event Detection

Sound event detection (SED) is the task of identifying sound events alon...
05/16/2019

Deep Reference Generation with Multi-Domain Hierarchical Constraints for Inter Prediction

Inter prediction is an important module in video coding for temporal red...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.