PixCUE – Joint Uncertainty Estimation and Image Reconstruction in MRI using Deep Pixel Classification

02/28/2023
by   Mevan Ekanayake, et al.
0

Deep learning (DL) models are capable of successfully exploiting latent representations in MR data and have become state-of-the-art for accelerated MRI reconstruction. However, undersampling the measurements in k-space as well as the over- or under-parameterized and non-transparent nature of DL make these models exposed to uncertainty. Consequently, uncertainty estimation has become a major issue in DL MRI reconstruction. To estimate uncertainty, Monte Carlo (MC) inference techniques have become a common practice where multiple reconstructions are utilized to compute the variance in reconstruction as a measurement of uncertainty. However, these methods demand high computational costs as they require multiple inferences through the DL model. To this end, we introduce a method to estimate uncertainty during MRI reconstruction using a pixel classification framework. The proposed method, PixCUE (stands for Pixel Classification Uncertainty Estimation) produces the reconstructed image along with an uncertainty map during a single forward pass through the DL model. We demonstrate that this approach generates uncertainty maps that highly correlate with the reconstruction errors with respect to various MR imaging sequences and under numerous adversarial conditions. We also show that the estimated uncertainties are correlated to that of the conventional MC method. We further provide an empirical relationship between the uncertainty estimations using PixCUE and well-established reconstruction metrics such as NMSE, PSNR, and SSIM. We conclude that PixCUE is capable of reliably estimating the uncertainty in MRI reconstruction with a minimum additional computational cost.

READ FULL TEXT

page 7

page 11

page 12

page 13

research
02/08/2019

Reducing Uncertainty in Undersampled MRI Reconstruction with Active Acquisition

The goal of MRI reconstruction is to restore a high fidelity image from ...
research
08/04/2023

Uncertainty Estimation and Propagation in Accelerated MRI Reconstruction

MRI reconstruction techniques based on deep learning have led to unprece...
research
07/24/2021

Deep-learning-driven Reliable Single-pixel Imaging with Uncertainty Approximation

Single-pixel imaging (SPI) has the advantages of high-speed acquisition ...
research
03/05/2022

Measurement-conditioned Denoising Diffusion Probabilistic Model for Under-sampled Medical Image Reconstruction

We propose a novel and unified method, measurement-conditioned denoising...
research
05/12/2023

Uncertainty Estimation for Deep Learning Image Reconstruction using a Local Lipschitz Metric

The use of deep learning approaches for image reconstruction is of conte...
research
11/21/2021

Calibrated Diffusion Tensor Estimation

It is highly desirable to know how uncertain a model's predictions are, ...
research
07/28/2018

RS-Net: Regression-Segmentation 3D CNN for Synthesis of Full Resolution Missing Brain MRI in the Presence of Tumours

Accurate synthesis of a full 3D MR image containing tumours from availab...

Please sign up or login with your details

Forgot password? Click here to reset