Tarsier: Evolving Noise Injection in Super-Resolution GANs

09/25/2020
by   Baptiste Roziere, et al.
0

Super-resolution aims at increasing the resolution and level of detail within an image. The current state of the art in general single-image super-resolution is held by NESRGAN+, which injects a Gaussian noise after each residual layer at training time. In this paper, we harness evolutionary methods to improve NESRGAN+ by optimizing the noise injection at inference time. More precisely, we use Diagonal CMA to optimize the injected noise according to a novel criterion combining quality assessment and realism. Our results are validated by the PIRM perceptual score and a human study. Our method outperforms NESRGAN+ on several standard super-resolution datasets. More generally, our approach can be used to optimize any method based on noise injection.

READ FULL TEXT

page 1

page 2

page 4

page 5

page 6

research
04/15/2021

Image Super-Resolution via Iterative Refinement

We present SR3, an approach to image Super-Resolution via Repeated Refin...
research
11/30/2022

FREDSR: Fourier Residual Efficient Diffusive GAN for Single Image Super Resolution

FREDSR is a GAN variant that aims to outperform traditional GAN models i...
research
07/14/2022

Perception-Oriented Stereo Image Super-Resolution

Recent studies of deep learning based stereo image super-resolution (Ste...
research
06/06/2022

Real-World Image Super-Resolution by Exclusionary Dual-Learning

Real-world image super-resolution is a practical image restoration probl...
research
07/02/2021

Unsupervised Single Image Super-resolution Under Complex Noise

While the researches on single image super-resolution (SISR), especially...
research
09/20/2022

Diabetic foot ulcers monitoring by employing super resolution and noise reduction deep learning techniques

Diabetic foot ulcers (DFUs) constitute a serious complication for people...
research
04/02/2021

Residual whiteness principle for automatic parameter selection in ℓ_2-ℓ_2 image super-resolution problems

We propose an automatic parameter selection strategy for variational ima...

Please sign up or login with your details

Forgot password? Click here to reset