Convolutional Proximal Neural Networks and Plug-and-Play Algorithms

11/04/2020
by   Johannes Hertrich, et al.
0

In this paper, we introduce convolutional proximal neural networks (cPNNs), which are by construction averaged operators. For filters of full length, we propose a stochastic gradient descent algorithm on a submanifold of the Stiefel manifold to train cPNNs. In case of filters with limited length, we design algorithms for minimizing functionals that approximate the orthogonality constraints imposed on the operators by penalizing the least squares distance to the identity operator. Then, we investigate how scaled cPNNs with a prescribed Lipschitz constant can be used for denoising signals and images, where the achieved quality depends on the Lipschitz constant. Finally, we apply cPNN based denoisers within a Plug-and-Play (PnP) framework and provide convergence results for the corresponding PnP forward-backward splitting algorithm based on an oracle construction.

READ FULL TEXT

page 21

page 27

research
09/17/2018

Projective Splitting with Forward Steps only Requires Continuity

A recent innovation in projective splitting algorithms for monotone oper...
research
08/06/2023

PNN: From proximal algorithms to robust unfolded image denoising networks and Plug-and-Play methods

A common approach to solve inverse imaging problems relies on finding a ...
research
03/19/2018

Projective Splitting with Forward Steps: Asynchronous and Block-Iterative Operator Splitting

This work is concerned with the classical problem of finding a zero of a...
research
09/08/2020

Primal-dual splitting scheme with backtracking for handling with epigraphic constraint and sparse analysis regularization

The convergence of many proximal algorithms involving a gradient descent...
research
07/02/2020

Efficient Proximal Mapping of the 1-path-norm of Shallow Networks

We demonstrate two new important properties of the 1-path-norm of shallo...
research
02/25/2022

Image reconstruction algorithms in radio interferometry: from handcrafted to learned denoisers

We introduce a new class of iterative image reconstruction algorithms fo...
research
05/14/2019

Plug-and-Play Methods Provably Converge with Properly Trained Denoisers

Plug-and-play (PnP) is a non-convex framework that integrates modern den...

Please sign up or login with your details

Forgot password? Click here to reset