Plug-and-Play external and internal priors for image restoration

02/15/2021
by   Pasquale Cascarano, et al.
10

Image restoration problems were traditionally formulated as the minimization of variational models, including data-fidelity and regularization terms, performed by optimization methods with well-established convergence properties. Recently, Plug-and-Play (PnP) methods for image restoration have obtained very good results and popularity by introducing, in iterative proximal algorithms, any off-the-shelf denoiser as priors. Deep Convolutional Neural Network (CNN) denoisers specify external priors (related to an outer training set) which well reflect image statistics; however they fail when dealing with unseen noise variance and image patterns in the given image. Conversely, the so-called internal denoisers induce internal priorsta ilored on the observed data, by forcing specific features on the desired image. We propose a new PnP scheme, based on the Half-Quadratic Splitting proximal algorithm, combining external and internal priors. Moreover, differently from other existing PnP methods, we propose a deep denoiser acting on the image gradient domain. Finally, we prove that a fixed point convergence is guaranteed for the proposed scheme under suitable conditions. In the experimental part, we use CNN denoisers and the Total Variation functional specifying external and internal priors, respectively. We prove the effectiveness of the proposed method in restoring blurred noisy images, both in simulated and real medical settings.

READ FULL TEXT

page 9

page 11

page 12

page 13

page 14

research
05/12/2017

External Prior Guided Internal Prior Learning for Real Noisy Image Denoising

Most of existing image denoising methods learn image priors from either ...
research
08/31/2020

Plug-and-Play Image Restoration with Deep Denoiser Prior

Recent works on plug-and-play image restoration have shown that a denois...
research
03/17/2019

Proximal Splitting Networks for Image Restoration

Image restoration problems are typically ill-posed requiring the design ...
research
10/07/2021

Gradient Step Denoiser for convergent Plug-and-Play

Plug-and-Play methods constitute a class of iterative algorithms for ima...
research
02/04/2021

Image Restoration by Deep Projected GSURE

Ill-posed inverse problems appear in many image processing applications,...
research
09/23/2020

ADMM-DIPTV: combining Total Variation and Deep Image Prior for image restoration

In the last decades, unsupervised deep learning based methods have caugh...
research
05/11/2014

Image Restoration Using Joint Statistical Modeling in Space-Transform Domain

This paper presents a novel strategy for high-fidelity image restoration...

Please sign up or login with your details

Forgot password? Click here to reset