Conditional Variational Autoencoder for Learned Image Reconstruction

10/22/2021
by   Chen Zhang, et al.
0

Learned image reconstruction techniques using deep neural networks have recently gained popularity, and have delivered promising empirical results. However, most approaches focus on one single recovery for each observation, and thus neglect the uncertainty information. In this work, we develop a novel computational framework that approximates the posterior distribution of the unknown image at each query observation. The proposed framework is very flexible: It handles implicit noise models and priors, it incorporates the data formation process (i.e., the forward operator), and the learned reconstructive properties are transferable between different datasets. Once the network is trained using the conditional variational autoencoder loss, it provides a computationally efficient sampler for the approximate posterior distribution via feed-forward propagation, and the summarizing statistics of the generated samples are used for both point-estimation and uncertainty quantification. We illustrate the proposed framework with extensive numerical experiments on positron emission tomography (with both moderate and low count levels) showing that the framework generates high-quality samples when compared with state-of-the-art methods.

READ FULL TEXT

page 13

page 15

page 16

page 17

page 18

research
10/27/2020

Deep Probabilistic Imaging: Uncertainty Quantification and Multi-modal Solution Characterization for Computational Imaging

Computational image reconstruction algorithms generally produce a single...
research
06/07/2023

Estimating Uncertainty in PET Image Reconstruction via Deep Posterior Sampling

Positron emission tomography (PET) is an important functional medical im...
research
07/06/2021

Unsupervised Knowledge-Transfer for Learned Image Reconstruction

Deep learning-based image reconstruction approaches have demonstrated im...
research
04/13/2022

Utilizing variational autoencoders in the Bayesian inverse problem of photoacoustic tomography

There has been an increasing interest in utilizing machine learning meth...
research
11/28/2013

Spatially-Adaptive Reconstruction in Computed Tomography using Neural Networks

We propose a supervised machine learning approach for boosting existing ...
research
07/19/2023

Learning-based approaches for reconstructions with inexact operators in nanoCT applications

Imaging problems such as the one in nanoCT require the solution of an in...
research
11/15/2020

Efficient Variational Inference for Sparse Deep Learning with Theoretical Guarantee

Sparse deep learning aims to address the challenge of huge storage consu...

Please sign up or login with your details

Forgot password? Click here to reset