PNN: From proximal algorithms to robust unfolded image denoising networks and Plug-and-Play methods

08/06/2023
by   Hoang Trieu Vy Le, et al.
0

A common approach to solve inverse imaging problems relies on finding a maximum a posteriori (MAP) estimate of the original unknown image, by solving a minimization problem. In thiscontext, iterative proximal algorithms are widely used, enabling to handle non-smooth functions and linear operators. Recently, these algorithms have been paired with deep learning strategies, to further improve the estimate quality. In particular, proximal neural networks (PNNs) have been introduced, obtained by unrolling a proximal algorithm as for finding a MAP estimate, but over a fixed number of iterations, with learned linear operators and parameters. As PNNs are based on optimization theory, they are very flexible, and can be adapted to any image restoration task, as soon as a proximal algorithm can solve it. They further have much lighter architectures than traditional networks. In this article we propose a unified framework to build PNNs for the Gaussian denoising task, based on both the dual-FB and the primal-dual Chambolle-Pock algorithms. We further show that accelerated inertial versions of these algorithms enable skip connections in the associated NN layers. We propose different learning strategies for our PNN framework, and investigate their robustness (Lipschitz property) and denoising efficiency. Finally, we assess the robustness of our PNNs when plugged in a forward-backward algorithm for an image deblurring problem.

READ FULL TEXT

page 14

page 15

page 17

page 18

page 23

page 24

research
07/02/2020

A deep primal-dual proximal network for image restoration

Image restoration remains a challenging task in image processing. Numero...
research
11/04/2020

Convolutional Proximal Neural Networks and Plug-and-Play Algorithms

In this paper, we introduce convolutional proximal neural networks (cPNN...
research
04/11/2017

Learning Proximal Operators: Using Denoising Networks for Regularizing Inverse Imaging Problems

While variational methods have been among the most powerful tools for so...
research
12/18/2019

Image Restoration using Plug-and-Play CNN MAP Denoisers

Plug-and-play denoisers can be used to perform generic image restoration...
research
03/16/2023

SUD^2: Supervision by Denoising Diffusion Models for Image Reconstruction

Many imaging inverse problemsx2014such as image-dependent in-painting an...
research
02/22/2020

Tuning-free Plug-and-Play Proximal Algorithm for Inverse Imaging Problems

Plug-and-play (PnP) is a non-convex framework that combines ADMM or othe...
research
07/20/2017

Learned Primal-dual Reconstruction

We propose the Learned Primal-Dual algorithm for tomographic reconstruct...

Please sign up or login with your details

Forgot password? Click here to reset