DeepAI
Log In Sign Up

A Single Video Super-Resolution GAN for Multiple Downsampling Operators based on Pseudo-Inverse Image Formation Models

07/02/2019
by   Santiago Lopez Tapia, et al.
2

The popularity of high and ultra-high definition displays has led to the need for methods to improve the quality of videos already obtained at much lower resolutions. Current Video Super-Resolution methods are not robust to mismatch between training and testing degradation models since they are trained against a single degradation model (usually bicubic downsampling). This causes their performance to deteriorate in real-life applications. At the same time, the use of only the Mean Squared Error during learning causes the resulting images to be too smooth. In this work we propose a new Convolutional Neural Network for video super resolution which is robust to multiple degradation models. During training, which is performed on a large dataset of scenes with slow and fast motions, it uses the pseudo-inverse image formation model as part of the network architecture in conjunction with perceptual losses, in addition to a smoothness constraint that eliminates the artifacts originating from these perceptual losses. The experimental validation shows that our approach outperforms current state-of-the-art methods and is robust to multiple degradations.

READ FULL TEXT

page 1

page 4

page 5

page 8

page 9

page 10

page 11

06/14/2018

Generative Adversarial Networks and Perceptual Losses for Video Super-Resolution

Video super-resolution has become one of the most critical problems in v...
06/15/2021

Perceptually-inspired super-resolution of compressed videos

Spatial resolution adaptation is a technique which has often been employ...
06/14/2022

AnimeSR: Learning Real-World Super-Resolution Models for Animation Videos

This paper studies the problem of real-world video super-resolution (VSR...
04/13/2020

Multi-modal Datasets for Super-resolution

Nowdays, most datasets used to train and evaluate super-resolution model...
02/23/2021

Deep Unrolled Network for Video Super-Resolution

Video super-resolution (VSR) aims to reconstruct a sequence of high-reso...
12/16/2020

Projected Distribution Loss for Image Enhancement

Features obtained from object recognition CNNs have been widely used for...
11/24/2021

Investigating Tradeoffs in Real-World Video Super-Resolution

The diversity and complexity of degradations in real-world video super-r...