Generalized Real-World Super-Resolution through Adversarial Robustness

08/25/2021
by   Angela Castillo, et al.
15

Real-world Super-Resolution (SR) has been traditionally tackled by first learning a specific degradation model that resembles the noise and corruption artifacts in low-resolution imagery. Thus, current methods lack generalization and lose their accuracy when tested on unseen types of corruption. In contrast to the traditional proposal, we present Robust Super-Resolution (RSR), a method that leverages the generalization capability of adversarial attacks to tackle real-world SR. Our novel framework poses a paradigm shift in the development of real-world SR methods. Instead of learning a dataset-specific degradation, we employ adversarial attacks to create difficult examples that target the model's weaknesses. Afterward, we use these adversarial examples during training to improve our model's capacity to process noisy inputs. We perform extensive experimentation on synthetic and real-world images and empirically demonstrate that our RSR method generalizes well across datasets without re-training for specific noise priors. By using a single robust model, we outperform state-of-the-art specialized methods on real-world benchmarks.

READ FULL TEXT

page 1

page 4

page 7

page 8

research
09/08/2021

Toward Real-World Super-Resolution via Adaptive Downsampling Models

Most image super-resolution (SR) methods are developed on synthetic low-...
research
01/08/2020

Learning to Zoom-in via Learning to Zoom-out: Real-world Super-resolution by Generating and Adapting Degradation

Most learning-based super-resolution (SR) methods aim to recover high-re...
research
05/24/2023

NegVSR: Augmenting Negatives for Generalized Noise Modeling in Real-World Video Super-Resolution

The capability of video super-resolution (VSR) to synthesize high-resolu...
research
04/13/2020

Multi-modal Datasets for Super-resolution

Nowdays, most datasets used to train and evaluate super-resolution model...
research
05/29/2023

Crafting Training Degradation Distribution for the Accuracy-Generalization Trade-off

Super-resolution (SR) techniques designed for real-world applications co...
research
10/10/2019

Practical License Plate Recognition in Unconstrained Surveillance Systems with Adversarial Super-Resolution

Although most current license plate (LP) recognition applications have b...
research
05/08/2022

Semi-Cycled Generative Adversarial Networks for Real-World Face Super-Resolution

Real-world face super-resolution (SR) is a highly ill-posed image restor...

Please sign up or login with your details

Forgot password? Click here to reset