Image Restoration using Autoencoding Priors

03/29/2017
by   Siavash Arjomand Bigdeli, et al.
0

We propose to leverage denoising autoencoder networks as priors to address image restoration problems. We build on the key observation that the output of an optimal denoising autoencoder is a local mean of the true data density, and the autoencoder error (the difference between the output and input of the trained autoencoder) is a mean shift vector. We use the magnitude of this mean shift vector, that is, the distance to the local mean, as the negative log likelihood of our natural image prior. For image restoration, we maximize the likelihood using gradient descent by backpropagating the autoencoder error. A key advantage of our approach is that we do not need to train separate networks for different image restoration tasks, such as non-blind deconvolution with different kernels, or super-resolution at different magnification factors. We demonstrate state of the art results for non-blind deconvolution and super-resolution using the same autoencoding prior.

READ FULL TEXT

page 1

page 6

page 7

page 8

research
09/12/2017

Deep Mean-Shift Priors for Image Restoration

In this paper we introduce a natural image prior that directly represent...
research
03/16/2020

Stochastic Frequency Masking to Improve Super-Resolution and Denoising Networks

Super-resolution and denoising are ill-posed yet fundamental image resto...
research
04/16/2019

A Deep Optimization Approach for Image Deconvolution

In blind image deconvolution, priors are often leveraged to constrain th...
research
06/21/2023

Accelerating Multiframe Blind Deconvolution via Deep Learning

Ground-based solar image restoration is a computationally expensive proc...
research
05/17/2019

Rethinking Atmospheric Turbulence Mitigation

State-of-the-art atmospheric turbulence image restoration methods utiliz...
research
03/17/2019

Proximal Splitting Networks for Image Restoration

Image restoration problems are typically ill-posed requiring the design ...
research
05/23/2023

A Dive into SAM Prior in Image Restoration

The goal of image restoration (IR), a fundamental issue in computer visi...

Please sign up or login with your details

Forgot password? Click here to reset