Regularization via deep generative models: an analysis point of view

01/21/2021
by   Thomas Oberlin, et al.
0

This paper proposes a new way of regularizing an inverse problem in imaging (e.g., deblurring or inpainting) by means of a deep generative neural network. Compared to end-to-end models, such approaches seem particularly interesting since the same network can be used for many different problems and experimental conditions, as soon as the generative model is suited to the data. Previous works proposed to use a synthesis framework, where the estimation is performed on the latent vector, the solution being obtained afterwards via the decoder. Instead, we propose an analysis formulation where we directly optimize the image itself and penalize the latent vector. We illustrate the interest of such a formulation by running experiments of inpainting, deblurring and super-resolution. In many cases our technique achieves a clear improvement of the performance and seems to be more robust, in particular with respect to initialization.

READ FULL TEXT

page 3

page 4

research
06/29/2023

Guided Deep Generative Model-based Spatial Regularization for Multiband Imaging Inverse Problems

When adopting a model-based formulation, solving inverse problems encoun...
research
02/15/2021

Intermediate Layer Optimization for Inverse Problems using Deep Generative Models

We propose Intermediate Layer Optimization (ILO), a novel optimization a...
research
03/22/2018

Guided Image Inpainting: Replacing an Image Region by Pulling Content from Another Image

Deep generative models have shown success in automatically synthesizing ...
research
11/30/2022

MrSARP: A Hierarchical Deep Generative Prior for SAR Image Super-resolution

Generative models learned from training using deep learning methods can ...
research
12/08/2020

Bayesian Image Reconstruction using Deep Generative Models

Machine learning models are commonly trained end-to-end and in a supervi...
research
05/23/2023

Deep Generative Model for Simultaneous Range Error Mitigation and Environment Identification

Received waveforms contain rich information for both range information a...
research
07/30/2020

Rewriting a Deep Generative Model

A deep generative model such as a GAN learns to model a rich set of sema...

Please sign up or login with your details

Forgot password? Click here to reset