Uncertainty Quantification for Deep Unrolling-Based Computational Imaging

07/02/2022
by   Canberk Ekmekci, et al.
1

Deep unrolling is an emerging deep learning-based image reconstruction methodology that bridges the gap between model-based and purely deep learning-based image reconstruction methods. Although deep unrolling methods achieve state-of-the-art performance for imaging problems and allow the incorporation of the observation model into the reconstruction process, they do not provide any uncertainty information about the reconstructed image, which severely limits their use in practice, especially for safety-critical imaging applications. In this paper, we propose a learning-based image reconstruction framework that incorporates the observation model into the reconstruction task and that is capable of quantifying epistemic and aleatoric uncertainties, based on deep unrolling and Bayesian neural networks. We demonstrate the uncertainty characterization capability of the proposed framework on magnetic resonance imaging and computed tomography reconstruction problems. We investigate the characteristics of the epistemic and aleatoric uncertainty information provided by the proposed framework to motivate future research on utilizing uncertainty information to develop more accurate, robust, trustworthy, uncertainty-aware, learning-based image reconstruction and analysis methods for imaging problems. We show that the proposed framework can provide uncertainty information while achieving comparable reconstruction performance to state-of-the-art deep unrolling methods.

READ FULL TEXT

page 1

page 8

page 9

page 10

page 12

page 14

page 18

research
11/17/2020

Quantifying Sources of Uncertainty in Deep Learning-Based Image Reconstruction

Image reconstruction methods based on deep neural networks have shown ou...
research
04/14/2023

Uncertainty-Aware Null Space Networks for Data-Consistent Image Reconstruction

Reconstructing an image from noisy and incomplete measurements is a cent...
research
06/07/2023

Estimating Uncertainty in PET Image Reconstruction via Deep Posterior Sampling

Positron emission tomography (PET) is an important functional medical im...
research
05/09/2019

A survey of computational frameworks for solving the acoustic inverse problem in three-dimensional photoacoustic computed tomography

Photoacoustic computed tomography (PACT), also known as optoacoustic tom...
research
10/25/2020

SUREMap: Predicting Uncertainty in CNN-based Image Reconstruction Using Stein's Unbiased Risk Estimate

Convolutional neural networks (CNN) have emerged as a powerful tool for ...
research
05/12/2023

Uncertainty Estimation for Deep Learning Image Reconstruction using a Local Lipschitz Metric

The use of deep learning approaches for image reconstruction is of conte...
research
01/26/2022

A Bayesian Based Deep Unrolling Algorithm for Single-Photon Lidar Systems

Deploying 3D single-photon Lidar imaging in real world applications face...

Please sign up or login with your details

Forgot password? Click here to reset