DeepAI AI Chat
Log In Sign Up

DUAL-GLOW: Conditional Flow-Based Generative Model for Modality Transfer

08/21/2019
by   Haoliang Sun, et al.
12

Positron emission tomography (PET) imaging is an imaging modality for diagnosing a number of neurological diseases. In contrast to Magnetic Resonance Imaging (MRI), PET is costly and involves injecting a radioactive substance into the patient. Motivated by developments in modality transfer in vision, we study the generation of certain types of PET images from MRI data. We derive new flow-based generative models which we show perform well in this small sample size regime (much smaller than dataset sizes available in standard vision tasks). Our formulation, DUAL-GLOW, is based on two invertible networks and a relation network that maps the latent spaces to each other. We discuss how given the prior distribution, learning the conditional distribution of PET given the MRI image reduces to obtaining the conditional distribution between the two latent codes w.r.t. the two image types. We also extend our framework to leverage 'side' information (or attributes) when available. By controlling the PET generation through 'conditioning' on age, our model is also able to capture brain FDG-PET (hypometabolism) changes, as a function of age. We present experiments on the Alzheimers Disease Neuroimaging Initiative (ADNI) dataset with 826 subjects, and obtain good performance in PET image synthesis, qualitatively and quantitatively better than recent works.

READ FULL TEXT

page 7

page 8

page 12

page 13

page 14

page 15

page 17

12/31/2020

FREA-Unet: Frequency-aware U-net for Modality Transfer

While Positron emission tomography (PET) imaging has been widely used in...
02/12/2022

Multi-task Deep Learning for Cerebrovascular Disease Classification and MRI-to-PET Translation

Accurate quantification of cerebral blood flow (CBF) is essential for th...
04/06/2022

SMU-Net: Style matching U-Net for brain tumor segmentation with missing modalities

Gliomas are one of the most prevalent types of primary brain tumours, ac...
06/11/2022

Physics-driven Deep Learning for PET/MRI

In this paper, we review physics- and data-driven reconstruction techniq...
08/03/2021

Image Augmentation Using a Task Guided Generative Adversarial Network for Age Estimation on Brain MRI

Brain age estimation based on magnetic resonance imaging (MRI) is an act...
01/11/2019

Disease Knowledge Transfer across Neurodegenerative Diseases

We introduce Disease Knowledge Transfer (DKT), a novel technique for tra...