Model-Aware Regularization For Learning Approaches To Inverse Problems

by   Jaweria Amjad, et al.

There are various inverse problems – including reconstruction problems arising in medical imaging – where one is often aware of the forward operator that maps variables of interest to the observations. It is therefore natural to ask whether such knowledge of the forward operator can be exploited in deep learning approaches increasingly used to solve inverse problems. In this paper, we provide one such way via an analysis of the generalisation error of deep learning methods applicable to inverse problems. In particular, by building on the algorithmic robustness framework, we offer a generalisation error bound that encapsulates key ingredients associated with the learning problem such as the complexity of the data space, the size of the training set, the Jacobian of the deep neural network and the Jacobian of the composition of the forward operator with the neural network. We then propose a 'plug-and-play' regulariser that leverages the knowledge of the forward map to improve the generalization of the network. We likewise also propose a new method allowing us to tightly upper bound the Lipschitz constants of the relevant functions that is much more computational efficient than existing ones. We demonstrate the efficacy of our model-aware regularised deep learning algorithms against other state-of-the-art approaches on inverse problems involving various sub-sampling operators such as those used in classical compressed sensing setup and accelerated Magnetic Resonance Imaging (MRI).


page 6

page 7

page 17

page 18

page 19


Training Adaptive Reconstruction Networks for Inverse Problems

Neural networks are full of promises for the resolution of ill-posed inv...

Deep Decomposition Learning for Inverse Imaging Problems

Deep learning is emerging as a new paradigm for solving inverse imaging ...

Deep learning for inverse problems with unknown operator

We consider ill-posed inverse problems where the forward operator T is u...

Model Adaptation for Inverse Problems in Imaging

Deep neural networks have been applied successfully to a wide variety of...

Unrolled Optimization with Deep Priors

A broad class of problems at the core of computational imaging, sensing,...

Pocket Guide to Solve Inverse Problems with GlobalBioIm

GlobalBioIm is an open-source MATLAB library for solving inverse problem...

Deep Learning Techniques for Inverse Problems in Imaging

Recent work in machine learning shows that deep neural networks can be u...

Please sign up or login with your details

Forgot password? Click here to reset