Video Super Resolution Based on Deep Learning: A comprehensive survey

07/25/2020
by   Hongying Liu, et al.
0

In recent years, deep learning has made great progress in the fields of image recognition, video analysis, natural language processing and speech recognition, including video super-resolution tasks. In this survey, we comprehensively investigate 28 state-of-the-art video super-resolution methods based on deep learning. It is well known that the leverage of information within video frames is important for video super-resolution. Hence we propose a taxonomy and classify the methods into six sub-categories according to the ways of utilizing inter-frame information. Moreover, the architectures and implementation details (including input and output, loss function and learning rate) of all the methods are depicted in details. Finally, we summarize and compare their performance on some benchmark datasets under different magnification factors. We also discuss some challenges, which need to be further addressed by researchers in the community of video super-resolution. Therefore, this work is expected to make a contribution to the future development of research in video super-resolution, and alleviate understandability and transferability of existing and future techniques into practice.

READ FULL TEXT

page 2

page 5

page 12

research
05/07/2019

Adapting Image Super-Resolution State-of-the-arts and Learning Multi-model Ensemble for Video Super-Resolution

Recently, image super-resolution has been widely studied and achieved si...
research
04/16/2019

A Deep Journey into Super-resolution: A survey

Deep convolutional networks based super-resolution is a fast-growing fie...
research
12/17/2020

Deep Learning Techniques for Super-Resolution in Video Games

The computational cost of video game graphics is increasing and hardware...
research
03/20/2022

Optical Flow for Video Super-Resolution: A Survey

Video super-resolution is currently one of the most active research topi...
research
10/19/2021

ERQA: Edge-Restoration Quality Assessment for Video Super-Resolution

Despite the growing popularity of video super-resolution (VSR), there is...
research
06/28/2017

Super-Resolution via Deep Learning

The recent phenomenal interest in convolutional neural networks (CNNs) m...
research
04/16/2021

Multitask Learning for VVC Quality Enhancement and Super-Resolution

The latest video coding standard, called versatile video coding (VVC), i...

Please sign up or login with your details

Forgot password? Click here to reset