Large Motion Video Super-Resolution with Dual Subnet and Multi-Stage Communicated Upsampling

03/22/2021
by   Hongying Liu, et al.
0

Video super-resolution (VSR) aims at restoring a video in low-resolution (LR) and improving it to higher-resolution (HR). Due to the characteristics of video tasks, it is very important that motion information among frames should be well concerned, summarized and utilized for guidance in a VSR algorithm. Especially, when a video contains large motion, conventional methods easily bring incoherent results or artifacts. In this paper, we propose a novel deep neural network with Dual Subnet and Multi-stage Communicated Upsampling (DSMC) for super-resolution of videos with large motion. We design a new module named U-shaped residual dense network with 3D convolution (U3D-RDN) for fine implicit motion estimation and motion compensation (MEMC) as well as coarse spatial feature extraction. And we present a new Multi-Stage Communicated Upsampling (MSCU) module to make full use of the intermediate results of upsampling for guiding the VSR. Moreover, a novel dual subnet is devised to aid the training of our DSMC, whose dual loss helps to reduce the solution space as well as enhance the generalization ability. Our experimental results confirm that our method achieves superior performance on videos with large motion compared to state-of-the-art methods.

READ FULL TEXT

page 3

page 6

page 7

research
08/25/2021

Memory-Augmented Non-Local Attention for Video Super-Resolution

In this paper, we propose a novel video super-resolution method that aim...
research
04/12/2021

Efficient Space-time Video Super Resolution using Low-Resolution Flow and Mask Upsampling

This paper explores an efficient solution for Space-time Super-Resolutio...
research
03/05/2022

A Novel Dual Dense Connection Network for Video Super-resolution

Video super-resolution (VSR) refers to the reconstruction of high-resolu...
research
12/06/2021

PP-MSVSR: Multi-Stage Video Super-Resolution

Different from the Single Image Super-Resolution(SISR) task, the key for...
research
01/05/2020

End-To-End Trainable Video Super-Resolution Based on a New Mechanism for Implicit Motion Estimation and Compensation

Video super-resolution aims at generating a high-resolution video from i...
research
05/24/2023

EgoVSR: Towards High-Quality Egocentric Video Super-Resolution

Due to the limitations of capture devices and scenarios, egocentric vide...
research
08/24/2020

Exploit Camera Raw Data for Video Super-Resolution via Hidden Markov Model Inference

To the best of our knowledge, the existing deep-learning-based Video Sup...

Please sign up or login with your details

Forgot password? Click here to reset