Towards Lower-Dose PET using Physics-Based Uncertainty-Aware Multimodal Learning with Robustness to Out-of-Distribution Data

by   Viswanath P Sudarshan, et al.

Radiation exposure in positron emission tomography (PET) imaging limits its usage in the studies of radiation-sensitive populations, e.g., pregnant women, children, and adults that require longitudinal imaging. Reducing the PET radiotracer dose or acquisition time reduces photon counts, which can deteriorate image quality. Recent deep-neural-network (DNN) based methods for image-to-image translation enable the mapping of low-quality PET images (acquired using substantially reduced dose), coupled with the associated magnetic resonance imaging (MRI) images, to high-quality PET images. However, such DNN methods focus on applications involving test data that match the statistical characteristics of the training data very closely and give little attention to evaluating the performance of these DNNs on new out-of-distribution (OOD) acquisitions. We propose a novel DNN formulation that models the (i) underlying sinogram-based physics of the PET imaging system and (ii) the uncertainty in the DNN output through the per-voxel heteroscedasticity of the residuals between the predicted and the high-quality reference images. Our sinogram-based uncertainty-aware DNN framework, namely, suDNN, estimates a standard-dose PET image using multimodal input in the form of (i) a low-dose/low-count PET image and (ii) the corresponding multi-contrast MRI images, leading to improved robustness of suDNN to OOD acquisitions. Results on in vivo simultaneous PET-MRI, and various forms of OOD data in PET-MRI, show the benefits of suDNN over the current state of the art, quantitatively and qualitatively.


page 10

page 15

page 22

page 25

page 27

page 33

page 34

page 37


Uncertainty-aware GAN with Adaptive Loss for Robust MRI Image Enhancement

Image-to-image translation is an ill-posed problem as unique one-to-one ...

CG-3DSRGAN: A classification guided 3D generative adversarial network for image quality recovery from low-dose PET images

Positron emission tomography (PET) is the most sensitive molecular imagi...

Masked Co-attentional Transformer reconstructs 100x ultra-fast/low-dose whole-body PET from longitudinal images and anatomically guided MRI

Despite its tremendous value for the diagnosis, treatment monitoring and...

P2T2: a Physically-primed deep-neural-network approach for robust T_2 distribution estimation from quantitative T_2-weighted MRI

Estimation of the T2 distribution from multi-echo T2-Weighted MRI (T2W) ...

FREA-Unet: Frequency-aware U-net for Modality Transfer

While Positron emission tomography (PET) imaging has been widely used in...

Fast improvement of TEM image with low-dose electrons by deep learning

Low-electron-dose observation is indispensable for observing various sam...

Faithful Synthesis of Low-dose Contrast-enhanced Brain MRI Scans using Noise-preserving Conditional GANs

Today Gadolinium-based contrast agents (GBCA) are indispensable in Magne...

Please sign up or login with your details

Forgot password? Click here to reset