Plug-and-Play Methods Provably Converge with Properly Trained Denoisers

05/14/2019
by   Ernest K. Ryu, et al.
9

Plug-and-play (PnP) is a non-convex framework that integrates modern denoising priors, such as BM3D or deep learning-based denoisers, into ADMM or other proximal algorithms. An advantage of PnP is that one can use pre-trained denoisers when there is not sufficient data for end-to-end training. Although PnP has been recently studied extensively with great empirical success, theoretical analysis addressing even the most basic question of convergence has been insufficient. In this paper, we theoretically establish convergence of PnP-FBS and PnP-ADMM, without using diminishing stepsizes, under a certain Lipschitz condition on the denoisers. We then propose real spectral normalization, a technique for training deep learning-based denoisers to satisfy the proposed Lipschitz condition. Finally, we present experimental results validating the theory.

READ FULL TEXT
research
10/19/2022

Provably Convergent Plug Play Linearized ADMM, applied to Deblurring Spatially Varying Kernels

Plug Play methods combine proximal algorithms with denoiser priors t...
research
08/17/2021

Instabilities in Plug-and-Play (PnP) algorithms from a learned denoiser

It's well-known that inverse problems are ill-posed and to solve them me...
research
05/11/2017

Fast Stochastic Variance Reduced ADMM for Stochastic Composition Optimization

We consider the stochastic composition optimization problem proposed in ...
research
02/22/2020

Tuning-free Plug-and-Play Proximal Algorithm for Inverse Imaging Problems

Plug-and-play (PnP) is a non-convex framework that combines ADMM or othe...
research
06/05/2020

Scalable Plug-and-Play ADMM with Convergence Guarantees

Plug-and-play priors (PnP) is a broadly applicable methodology for solvi...
research
06/27/2022

Theoretical analysis of Adam using hyperparameters close to one without Lipschitz smoothness

Convergence and convergence rate analyses of adaptive methods, such as A...
research
11/04/2020

Convolutional Proximal Neural Networks and Plug-and-Play Algorithms

In this paper, we introduce convolutional proximal neural networks (cPNN...

Please sign up or login with your details

Forgot password? Click here to reset