Large Motion Video Super-Resolution with Dual Subnet and Multi-Stage Communicated Upsampling

03/22/2021
by   Hongying Liu, et al.
0

Video super-resolution (VSR) aims at restoring a video in low-resolution (LR) and improving it to higher-resolution (HR). Due to the characteristics of video tasks, it is very important that motion information among frames should be well concerned, summarized and utilized for guidance in a VSR algorithm. Especially, when a video contains large motion, conventional methods easily bring incoherent results or artifacts. In this paper, we propose a novel deep neural network with Dual Subnet and Multi-stage Communicated Upsampling (DSMC) for super-resolution of videos with large motion. We design a new module named U-shaped residual dense network with 3D convolution (U3D-RDN) for fine implicit motion estimation and motion compensation (MEMC) as well as coarse spatial feature extraction. And we present a new Multi-Stage Communicated Upsampling (MSCU) module to make full use of the intermediate results of upsampling for guiding the VSR. Moreover, a novel dual subnet is devised to aid the training of our DSMC, whose dual loss helps to reduce the solution space as well as enhance the generalization ability. Our experimental results confirm that our method achieves superior performance on videos with large motion compared to state-of-the-art methods.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 3

page 6

page 7

08/25/2021

Memory-Augmented Non-Local Attention for Video Super-Resolution

In this paper, we propose a novel video super-resolution method that aim...
04/12/2021

Efficient Space-time Video Super Resolution using Low-Resolution Flow and Mask Upsampling

This paper explores an efficient solution for Space-time Super-Resolutio...
12/06/2021

PP-MSVSR: Multi-Stage Video Super-Resolution

Different from the Single Image Super-Resolution(SISR) task, the key for...
01/05/2020

End-To-End Trainable Video Super-Resolution Based on a New Mechanism for Implicit Motion Estimation and Compensation

Video super-resolution aims at generating a high-resolution video from i...
08/24/2020

Exploit Camera Raw Data for Video Super-Resolution via Hidden Markov Model Inference

To the best of our knowledge, the existing deep-learning-based Video Sup...
03/29/2021

Video Classification with FineCoarse Networks

A rich representation of the information in video data can be realized b...
10/19/2019

Component Attention Guided Face Super-Resolution Network: CAGFace

To make the best use of the underlying structure of faces, the collectiv...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.