Regularising Inverse Problems with Generative Machine Learning Models

07/22/2021
by   Margaret Duff, et al.
8

Deep neural network approaches to inverse imaging problems have produced impressive results in the last few years. In this paper, we consider the use of generative models in a variational regularisation approach to inverse problems. The considered regularisers penalise images that are far from the range of a generative model that has learned to produce images similar to a training dataset. We name this family generative regularisers. The success of generative regularisers depends on the quality of the generative model and so we propose a set of desired criteria to assess models and guide future research. In our numerical experiments, we evaluate three common generative models, autoencoders, variational autoencoders and generative adversarial networks, against our desired criteria. We also test three different generative regularisers on the inverse problems of deblurring, deconvolution, and tomography. We show that the success of solutions restricted to lie exactly in the range of the generator is highly dependent on the ability of the generative model but that allowing small deviations from the range of the generator produces more consistent results.

READ FULL TEXT

page 18

page 19

page 21

page 22

page 23

page 26

page 28

page 29

research
10/23/2019

Low Shot Learning with Untrained Neural Networks for Imaging Inverse Problems

Employing deep neural networks as natural image priors to solve inverse ...
research
03/20/2023

Inverse problem regularization with hierarchical variational autoencoders

In this paper, we propose to regularize ill-posed inverse problems using...
research
03/15/2022

Generative models and Bayesian inversion using Laplace approximation

The Bayesian approach to solving inverse problems relies on the choice o...
research
03/19/2022

Modelling nonlinear dependencies in the latent space of inverse scattering

The problem of inverse scattering proposed by Angles and Mallat in 2018,...
research
10/08/2018

Algorithmic Aspects of Inverse Problems Using Generative Models

The traditional approach of hand-crafting priors (such as sparsity) for ...
research
02/01/2022

Sinogram Enhancement with Generative Adversarial Networks using Shape Priors

Compensating scarce measurements by inferring them from computational mo...
research
12/22/2022

Deep learning for size-agnostic inverse design of random-network 3D printed mechanical metamaterials

Practical applications of mechanical metamaterials often involve solving...

Please sign up or login with your details

Forgot password? Click here to reset