Uncertainty Estimation for Deep Learning Image Reconstruction using a Local Lipschitz Metric

05/12/2023
by   Danyal F. Bhutto, et al.
0

The use of deep learning approaches for image reconstruction is of contemporary interest in radiology, especially for approaches that solve inverse problems associated with imaging. In deployment, these models may be exposed to input distributions that are widely shifted from training data, due in part to data biases or drifts. We propose a metric based on local Lipschitz determined from a single trained model that can be used to estimate the model uncertainty for image reconstructions. We demonstrate a monotonic relationship between the local Lipschitz value and Mean Absolute Error and show that this method can be used to provide a threshold that determines whether a given DL reconstruction approach was well suited to the task. Our uncertainty estimation method can be used to identify out-of-distribution test samples, relate information regarding epistemic uncertainties, and guide proper data augmentation. Quantifying uncertainty of learned reconstruction approaches is especially pertinent to the medical domain where reconstructed images must remain diagnostically accurate.

READ FULL TEXT

page 9

page 10

page 11

page 12

page 13

research
11/17/2020

Quantifying Sources of Uncertainty in Deep Learning-Based Image Reconstruction

Image reconstruction methods based on deep neural networks have shown ou...
research
07/02/2022

Uncertainty Quantification for Deep Unrolling-Based Computational Imaging

Deep unrolling is an emerging deep learning-based image reconstruction m...
research
02/28/2023

PixCUE – Joint Uncertainty Estimation and Image Reconstruction in MRI using Deep Pixel Classification

Deep learning (DL) models are capable of successfully exploiting latent ...
research
04/14/2023

Uncertainty-Aware Null Space Networks for Data-Consistent Image Reconstruction

Reconstructing an image from noisy and incomplete measurements is a cent...
research
03/27/2020

Interval Neural Networks as Instability Detectors for Image Reconstructions

This work investigates the detection of instabilities that may occur whe...
research
10/21/2021

Towards Reducing Aleatoric Uncertainty for Medical Imaging Tasks

In safety-critical applications like medical diagnosis, certainty associ...
research
08/01/2023

Body Knowledge and Uncertainty Modeling for Monocular 3D Human Body Reconstruction

While 3D body reconstruction methods have made remarkable progress recen...

Please sign up or login with your details

Forgot password? Click here to reset