SRDGAN: learning the noise prior for Super Resolution with Dual Generative Adversarial Networks

03/28/2019
by   Jingwei Guan, et al.
0

Single Image Super Resolution (SISR) is the task of producing a high resolution (HR) image from a given low-resolution (LR) image. It is a well researched problem with extensive commercial applications such as digital camera, video compression, medical imaging and so on. Most super resolution works focus on the features learning architecture, which can recover the texture details as close as possible. However, these works suffer from the following challenges: (1) The low-resolution (LR) training images are artificially synthesized using HR images with bicubic downsampling, which have much richer-information than real demosaic-upscaled mobile images. The mismatch between training and inference mobile data heavily blocks the improvement of practical super resolution algorithms. (2) These methods cannot effectively handle the blind distortions during super resolution in practical applications. In this work, an end-to-end novel framework, including high-to-low network and low-to-high network, is proposed to solve the above problems with dual Generative Adversarial Networks (GAN). First, the above mismatch problems are well explored with the high-to-low network, where clear high-resolution image and the corresponding realistic low-resolution image pairs can be generated. Moreover, a large-scale General Mobile Super Resolution Dataset, GMSR, is proposed, which can be utilized for training or as a fair comparison benchmark for super resolution methods. Second, an effective low-to-high network (super resolution network) is proposed in the framework. Benefiting from the GMSR dataset and novel training strategies, the super resolution model can effectively handle detail recovery and denoising at the same time.

READ FULL TEXT

page 1

page 4

page 7

page 8

research
07/30/2018

To learn image super-resolution, use a GAN to learn how to do image degradation first

This paper is on image and face super-resolution. The vast majority of p...
research
03/29/2021

Best-Buddy GANs for Highly Detailed Image Super-Resolution

We consider the single image super-resolution (SISR) problem, where a hi...
research
10/09/2020

Attaining Real-Time Super-Resolution for Microscopic Images Using GAN

In the last few years, several deep learning models, especially Generati...
research
10/28/2022

Nonparallel High-Quality Audio Super Resolution with Domain Adaptation and Resampling CycleGANs

Neural audio super-resolution models are typically trained on low- and h...
research
02/28/2022

OUR-GAN: One-shot Ultra-high-Resolution Generative Adversarial Networks

We propose OUR-GAN, the first one-shot ultra-high-resolution (UHR) image...
research
07/25/2022

NeuriCam: Video Super-Resolution and Colorization Using Key Frames

We present NeuriCam, a key-frame video super-resolution and colorization...
research
04/09/2020

Multi-feature super-resolution network for cloth wrinkle synthesis

Existing physical cloth simulators suffer from expensive computation and...

Please sign up or login with your details

Forgot password? Click here to reset