Deep Unfolding of a Proximal Interior Point Method for Image Restoration

12/11/2018
by   Marie-Caroline Corbineau, et al.
0

Variational methods are widely applied to ill-posed inverse problems for they have the ability to embed prior knowledge about the solution. However, the level of performance of these methods significantly depends on a set of parameters, which can be estimated through computationally expensive and time-consuming methods. In contrast, deep learning offers very generic and efficient architectures, at the expense of explainability, since it is often used as a black-box, without any fine control over its output. Deep unfolding provides a convenient approach to combine variational-based and deep learning approaches. Starting from a variational formulation for image restoration, we develop iRestNet, a neural network architecture obtained by unfolding a proximal interior point algorithm. Hard constraints, encoding desirable properties for the restored image, are incorporated into the network thanks to a logarithmic barrier, while the barrier parameter, the stepsize, and the penalization weight are learned by the network. We derive explicit expressions for the gradient of the proximity operator for various choices of constraints, which allows training iRestNet with gradient descent and backpropagation. In addition, we provide theoretical results regarding the stability of the network for a common inverse problem example. Numerical experiments on image deblurring problems show that the proposed approach compares favorably with both state-of-the-art variational and machine learning methods in terms of image quality.

READ FULL TEXT

page 24

page 25

research
06/06/2023

Convergent Bregman Plug-and-Play Image Restoration for Poisson Inverse Problems

Plug-and-Play (PnP) methods are efficient iterative algorithms for solvi...
research
03/20/2023

Inverse problem regularization with hierarchical variational autoencoders

In this paper, we propose to regularize ill-posed inverse problems using...
research
04/11/2017

Learning Proximal Operators: Using Denoising Networks for Regularizing Inverse Imaging Problems

While variational methods have been among the most powerful tools for so...
research
07/19/2019

An Optimal Control Approach to Early Stopping Variational Methods for Image Restoration

We investigate a well-known phenomenon of variational approaches in imag...
research
03/17/2019

Proximal Splitting Networks for Image Restoration

Image restoration problems are typically ill-posed requiring the design ...
research
01/14/2020

Total Deep Variation for Linear Inverse Problems

Diverse inverse problems in imaging can be cast as variational problems ...
research
10/18/2022

Explainable bilevel optimization: an application to the Helsinki deblur challenge

In this paper we present a bilevel optimization scheme for the solution ...

Please sign up or login with your details

Forgot password? Click here to reset