DeepAI AI Chat
Log In Sign Up

Bidirectional Mapping Generative Adversarial Networks for Brain MR to PET Synthesis

by   Shengye Hu, et al.

Fusing multi-modality medical images, such as MR and PET, can provide various anatomical or functional information about human body. But PET data is always unavailable due to different reasons such as cost, radiation, or other limitations. In this paper, we propose a 3D end-to-end synthesis network, called Bidirectional Mapping Generative Adversarial Networks (BMGAN), where image contexts and latent vector are effectively used and jointly optimized for brain MR-to-PET synthesis. Concretely, a bidirectional mapping mechanism is designed to embed the semantic information of PET images into the high dimensional latent space. And the 3D DenseU-Net generator architecture and the extensive objective functions are further utilized to improve the visual quality of synthetic results. The most appealing part is that the proposed method can synthesize the perceptually realistic PET images while preserving the diverse brain structures of different subjects. Experimental results demonstrate that the performance of the proposed method outperforms other competitive cross-modality synthesis methods in terms of quantitative measures, qualitative displays, and classification evaluation.


page 1

page 4

page 7

page 8

page 10


Multi-Modality Generative Adversarial Networks with Tumor Consistency Loss for Brain MR Image Synthesis

Magnetic Resonance (MR) images of different modalities can provide compl...

Causal Image Synthesis of Brain MR in 3D

Clinical decision making requires counterfactual reasoning based on a fa...

Geometrically Matched Multi-source Microscopic Image Synthesis Using Bidirectional Adversarial Networks

Microscopic images from different modality can provide more complete exp...

LoGANv2: Conditional Style-Based Logo Generation with Generative Adversarial Networks

Domains such as logo synthesis, in which the data has a high degree of m...

PortraitGAN for Flexible Portrait Manipulation

Previous methods have dealt with discrete manipulation of facial attribu...