Stochastic Frequency Masking to Improve Super-Resolution and Denoising Networks

03/16/2020
by   Majed El Helou, et al.
0

Super-resolution and denoising are ill-posed yet fundamental image restoration tasks. In blind settings, the degradation kernel or the noise level are unknown. This makes restoration even more challenging, notably for learning-based methods, as they tend to overfit to the degradation seen during training. We present an analysis, in the frequency domain, of degradation-kernel overfitting in super-resolution and introduce a conditional learning perspective that extends to both super-resolution and denoising. Building on our formulation, we propose a stochastic frequency masking of images used in training to regularize the networks and address the overfitting problem. Our technique improves state-of-the-art methods on blind super-resolution with different synthetic kernels, real super-resolution, blind Gaussian denoising, and real-image denoising.

READ FULL TEXT

page 2

page 5

page 9

page 13

page 14

research
09/25/2020

Blind Image Super-Resolution with Spatial Context Hallucination

Deep convolution neural networks (CNNs) play a critical role in single i...
research
07/30/2018

Multi-bin Trainable Linear Unit for Fast Image Restoration Networks

Tremendous advances in image restoration tasks such as denoising and sup...
research
04/29/2023

Sparsity-Aware Optimal Transport for Unsupervised Restoration Learning

Recent studies show that, without any prior model, the unsupervised rest...
research
07/02/2021

On Measuring and Controlling the Spectral Bias of the Deep Image Prior

The deep image prior has demonstrated the remarkable ability that untrai...
research
06/01/2021

Two-stage domain adapted training for better generalization in real-world image restoration and super-resolution

It is well-known that in inverse problems, end-to-end trained networks o...
research
05/20/2023

Dual-Diffusion: Dual Conditional Denoising Diffusion Probabilistic Models for Blind Super-Resolution Reconstruction in RSIs

Previous super-resolution reconstruction (SR) works are always designed ...
research
03/29/2017

Image Restoration using Autoencoding Priors

We propose to leverage denoising autoencoder networks as priors to addre...

Please sign up or login with your details

Forgot password? Click here to reset