AmbientFlow: Invertible generative models from incomplete, noisy measurements

09/09/2023
by   Varun A. Kelkar, et al.
0

Generative models have gained popularity for their potential applications in imaging science, such as image reconstruction, posterior sampling and data sharing. Flow-based generative models are particularly attractive due to their ability to tractably provide exact density estimates along with fast, inexpensive and diverse samples. Training such models, however, requires a large, high quality dataset of objects. In applications such as computed imaging, it is often difficult to acquire such data due to requirements such as long acquisition time or high radiation dose, while acquiring noisy or partially observed measurements of these objects is more feasible. In this work, we propose AmbientFlow, a framework for learning flow-based generative models directly from noisy and incomplete data. Using variational Bayesian methods, a novel framework for establishing flow-based generative models from noisy, incomplete data is proposed. Extensive numerical studies demonstrate the effectiveness of AmbientFlow in correctly learning the object distribution. The utility of AmbientFlow in a downstream inference task of image reconstruction is demonstrated.

READ FULL TEXT

page 5

page 6

page 7

page 9

page 10

research
08/27/2023

Score-Based Generative Models for PET Image Reconstruction

Score-based generative models have demonstrated highly promising results...
research
03/18/2022

Bayesian Inversion for Nonlinear Imaging Models using Deep Generative Priors

Most modern imaging systems involve a computational reconstruction pipel...
research
10/22/2019

Uncertainty Quantification with Generative Models

We develop a generative model-based approach to Bayesian inverse problem...
research
06/24/2023

Score-based Generative Models for Photoacoustic Image Reconstruction with Rotation Consistency Constraints

Photoacoustic tomography (PAT) is a newly emerged imaging modality which...
research
05/13/2020

Subsampled Fourier Ptychography using Pretrained Invertible and Untrained Network Priors

Recently pretrained generative models have shown promising results for s...
research
12/18/2020

Flow-based Generative Models for Learning Manifold to Manifold Mappings

Many measurements or observations in computer vision and machine learnin...
research
04/03/2021

Training Deep Normalizing Flow Models in Highly Incomplete Data Scenarios with Prior Regularization

Deep generative frameworks including GANs and normalizing flow models ha...

Please sign up or login with your details

Forgot password? Click here to reset