DeepAI AI Chat
Log In Sign Up

Uncertainty-aware GAN with Adaptive Loss for Robust MRI Image Enhancement

by   Uddeshya Upadhyay, et al.
Tata Consultancy Services
IIT Bombay

Image-to-image translation is an ill-posed problem as unique one-to-one mapping may not exist between the source and target images. Learning-based methods proposed in this context often evaluate the performance on test data that is similar to the training data, which may be impractical. This demands robust methods that can quantify uncertainty in the prediction for making informed decisions, especially for critical areas such as medical imaging. Recent works that employ conditional generative adversarial networks (GANs) have shown improved performance in learning photo-realistic image-to-image mappings between the source and the target images. However, these methods do not focus on (i) robustness of the models to out-of-distribution (OOD)-noisy data and (ii) uncertainty quantification. This paper proposes a GAN-based framework that (i) models an adaptive loss function for robustness to OOD-noisy data that automatically tunes the spatially varying norm for penalizing the residuals and (ii) estimates the per-voxel uncertainty in the predictions. We demonstrate our method on two key applications in medical imaging: (i) undersampled magnetic resonance imaging (MRI) reconstruction (ii) MRI modality propagation. Our experiments with two different real-world datasets show that the proposed method (i) is robust to OOD-noisy test data and provides improved accuracy and (ii) quantifies voxel-level uncertainty in the predictions.


page 4

page 5

page 6

page 7

page 8


Uncertainty-Guided Progressive GANs for Medical Image Translation

Image-to-image translation plays a vital role in tackling various medica...

Disentangled Uncertainty and Out of Distribution Detection in Medical Generative Models

Trusting the predictions of deep learning models in safety critical sett...

Robustness via Uncertainty-aware Cycle Consistency

Unpaired image-to-image translation refers to learning inter-image-domai...

Segmentation-Renormalized Deep Feature Modulation for Unpaired Image Harmonization

Deep networks are now ubiquitous in large-scale multi-center imaging stu...

What can we learn about a generated image corrupting its latent representation?

Generative adversarial networks (GANs) offer an effective solution to th...