Uncertainty-Aware Null Space Networks for Data-Consistent Image Reconstruction

04/14/2023
by   Christoph Angermann, et al.
0

Reconstructing an image from noisy and incomplete measurements is a central task in several image processing applications. In recent years, state-of-the-art reconstruction methods have been developed based on recent advances in deep learning. Especially for highly underdetermined problems, maintaining data consistency is a key goal. This can be achieved either by iterative network architectures or by a subsequent projection of the network reconstruction. However, for such approaches to be used in safety-critical domains such as medical imaging, the network reconstruction should not only provide the user with a reconstructed image, but also with some level of confidence in the reconstruction. In order to meet these two key requirements, this paper combines deep null-space networks with uncertainty quantification. Evaluation of the proposed method includes image reconstruction from undersampled Radon measurements on a toy CT dataset and accelerated MRI reconstruction on the fastMRI dataset. This work is the first approach to solving inverse problems that additionally models data-dependent uncertainty by estimating an input-dependent scale map, providing a robust assessment of reconstruction quality.

READ FULL TEXT

page 10

page 12

page 14

page 16

research
07/02/2022

Uncertainty Quantification for Deep Unrolling-Based Computational Imaging

Deep unrolling is an emerging deep learning-based image reconstruction m...
research
12/19/2019

Neural Networks-based Regularization of Large-Scale Inverse Problems in Medical Imaging

In this paper we present a generalized Deep Learning-based approach to s...
research
08/31/2020

Data and Image Prior Integration for Image Reconstruction Using Consensus Equilibrium

Image domain prior models have been shown to improve the quality of reco...
research
11/25/2019

Invert to Learn to Invert

Iterative learning to infer approaches have become popular solvers for i...
research
05/12/2023

Uncertainty Estimation for Deep Learning Image Reconstruction using a Local Lipschitz Metric

The use of deep learning approaches for image reconstruction is of conte...
research
03/27/2020

Interval Neural Networks as Instability Detectors for Image Reconstructions

This work investigates the detection of instabilities that may occur whe...
research
07/18/2020

Learning Geometry-Dependent and Physics-Based Inverse Image Reconstruction

Deep neural networks have shown great potential in image reconstruction ...

Please sign up or login with your details

Forgot password? Click here to reset