Two-stage domain adapted training for better generalization in real-world image restoration and super-resolution

06/01/2021
by   Cansu Korkmaz, et al.
0

It is well-known that in inverse problems, end-to-end trained networks overfit the degradation model seen in the training set, i.e., they do not generalize to other types of degradations well. Recently, an approach to first map images downsampled by unknown filters to bicubicly downsampled look-alike images was proposed to successfully super-resolve such images. In this paper, we show that any inverse problem can be formulated by first mapping the input degraded images to an intermediate domain, and then training a second network to form output images from these intermediate images. Furthermore, the best intermediate domain may vary according to the task. Our experimental results demonstrate that this two-stage domain-adapted training strategy does not only achieve better results on a given class of unknown degradations but can also generalize to other unseen classes of degradations better.

READ FULL TEXT

page 1

page 4

research
03/16/2020

Stochastic Frequency Masking to Improve Super-Resolution and Denoising Networks

Super-resolution and denoising are ill-posed yet fundamental image resto...
research
11/18/2019

AIM 2019 Challenge on Real-World Image Super-Resolution: Methods and Results

This paper reviews the AIM 2019 challenge on real world super-resolution...
research
12/01/2017

InverseNet: Solving Inverse Problems with Splitting Networks

We propose a new method that uses deep learning techniques to solve the ...
research
11/30/2018

Super-Resolution based on Image-Adapted CNN Denoisers: Incorporating Generalization of Training Data and Internal Learning in Test Time

While deep neural networks exhibit state-of-the-art results in the task ...
research
05/03/2020

Joint-SRVDNet: Joint Super Resolution and Vehicle Detection Network

In many domestic and military applications, aerial vehicle detection and...
research
05/29/2023

Crafting Training Degradation Distribution for the Accuracy-Generalization Trade-off

Super-resolution (SR) techniques designed for real-world applications co...

Please sign up or login with your details

Forgot password? Click here to reset