Toward Real-World Super-Resolution via Adaptive Downsampling Models

09/08/2021
by   Sanghyun Son, et al.
0

Most image super-resolution (SR) methods are developed on synthetic low-resolution (LR) and high-resolution (HR) image pairs that are constructed by a predetermined operation, e.g., bicubic downsampling. As existing methods typically learn an inverse mapping of the specific function, they produce blurry results when applied to real-world images whose exact formulation is different and unknown. Therefore, several methods attempt to synthesize much more diverse LR samples or learn a realistic downsampling model. However, due to restrictive assumptions on the downsampling process, they are still biased and less generalizable. This study proposes a novel method to simulate an unknown downsampling process without imposing restrictive prior knowledge. We propose a generalizable low-frequency loss (LFL) in the adversarial training framework to imitate the distribution of target LR images without using any paired examples. Furthermore, we design an adaptive data loss (ADL) for the downsampler, which can be adaptively learned and updated from the data during the training loops. Extensive experiments validate that our downsampling model can facilitate existing SR methods to perform more accurate reconstructions on various synthetic and real-world examples than the conventional approaches.

READ FULL TEXT

page 6

page 9

page 10

page 11

page 13

page 17

page 18

page 19

research
10/20/2021

Toward Real-world Image Super-resolution via Hardware-based Adaptive Degradation Models

Most single image super-resolution (SR) methods are developed on synthet...
research
11/18/2019

Frequency Separation for Real-World Super-Resolution

Most of the recent literature on image super-resolution (SR) assumes the...
research
08/25/2021

Generalized Real-World Super-Resolution through Adversarial Robustness

Real-world Super-Resolution (SR) has been traditionally tackled by first...
research
12/21/2019

Style-based Variational Autoencoder for Real-World Super-Resolution

Real-world image super-resolution is a challenging image translation pro...
research
03/16/2020

Closed-loop Matters: Dual Regression Networks for Single Image Super-Resolution

Deep neural networks have exhibited promising performance in image super...
research
02/26/2020

Unpaired Image Super-Resolution using Pseudo-Supervision

In most studies on learning-based image super-resolution (SR), the paire...
research
08/05/2021

Dual-reference Training Data Acquisition and CNN Construction for Image Super-Resolution

For deep learning methods of image super-resolution, the most critical i...

Please sign up or login with your details

Forgot password? Click here to reset