CDFI: Compression-Driven Network Design for Frame Interpolation

by   Tianyu Ding, et al.

DNN-based frame interpolation–that generates the intermediate frames given two consecutive frames–typically relies on heavy model architectures with a huge number of features, preventing them from being deployed on systems with limited resources, e.g., mobile devices. We propose a compression-driven network design for frame interpolation (CDFI), that leverages model pruning through sparsity-inducing optimization to significantly reduce the model size while achieving superior performance. Concretely, we first compress the recently proposed AdaCoF model and show that a 10X compressed AdaCoF performs similarly as its original counterpart; then we further improve this compressed model by introducing a multi-resolution warping module, which boosts visual consistencies with multi-level details. As a consequence, we achieve a significant performance gain with only a quarter in size compared with the original AdaCoF. Moreover, our model performs favorably against other state-of-the-arts in a broad range of datasets. Finally, the proposed compression-driven framework is generic and can be easily transferred to other DNN-based frame interpolation algorithm. Our source code is available at



There are no comments yet.


page 1

page 3

page 4

page 6

page 8


Asymmetric Bilateral Motion Estimation for Video Frame Interpolation

We propose a novel video frame interpolation algorithm based on asymmetr...

PointINet: Point Cloud Frame Interpolation Network

LiDAR point cloud streams are usually sparse in time dimension, which is...

FastRIFE: Optimization of Real-Time Intermediate Flow Estimation for Video Frame Interpolation

The problem of video inter-frame interpolation is an essential task in t...

Multi-Frame Quality Enhancement for Compressed Video

The past few years have witnessed great success in applying deep learnin...

RIFE: Real-Time Intermediate Flow Estimation for Video Frame Interpolation

We propose RIFE, a Real-time Intermediate Flow Estimation algorithm for ...

ROSITA: Refined BERT cOmpreSsion with InTegrAted techniques

Pre-trained language models of the BERT family have defined the state-of...

Sparsity Meets Robustness: Channel Pruning for the Feynman-Kac Formalism Principled Robust Deep Neural Nets

Deep neural nets (DNNs) compression is crucial for adaptation to mobile ...

Code Repositories


Code of paper "CDFI: Compression-Driven Network Design for Frame Interpolation", CVPR 2021

view repo
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.