Bidirectional Mapping Generative Adversarial Networks for Brain MR to PET Synthesis

by   Shengye Hu, et al.

Fusing multi-modality medical images, such as MR and PET, can provide various anatomical or functional information about human body. But PET data is always unavailable due to different reasons such as cost, radiation, or other limitations. In this paper, we propose a 3D end-to-end synthesis network, called Bidirectional Mapping Generative Adversarial Networks (BMGAN), where image contexts and latent vector are effectively used and jointly optimized for brain MR-to-PET synthesis. Concretely, a bidirectional mapping mechanism is designed to embed the semantic information of PET images into the high dimensional latent space. And the 3D DenseU-Net generator architecture and the extensive objective functions are further utilized to improve the visual quality of synthetic results. The most appealing part is that the proposed method can synthesize the perceptually realistic PET images while preserving the diverse brain structures of different subjects. Experimental results demonstrate that the performance of the proposed method outperforms other competitive cross-modality synthesis methods in terms of quantitative measures, qualitative displays, and classification evaluation.



There are no comments yet.


page 1

page 4

page 7

page 8

page 10


Multi-Modality Generative Adversarial Networks with Tumor Consistency Loss for Brain MR Image Synthesis

Magnetic Resonance (MR) images of different modalities can provide compl...

3D-StyleGAN: A Style-Based Generative Adversarial Network for Generative Modeling of Three-Dimensional Medical Images

Image synthesis via Generative Adversarial Networks (GANs) of three-dime...

Geometrically Matched Multi-source Microscopic Image Synthesis Using Bidirectional Adversarial Networks

Microscopic images from different modality can provide more complete exp...

DeepVecFont: Synthesizing High-quality Vector Fonts via Dual-modality Learning

Automatic font generation based on deep learning has aroused a lot of in...

LoGANv2: Conditional Style-Based Logo Generation with Generative Adversarial Networks

Domains such as logo synthesis, in which the data has a high degree of m...

mustGAN: Multi-Stream Generative Adversarial Networks for MR Image Synthesis

Multi-contrast MRI protocols increase the level of morphological informa...

PortraitGAN for Flexible Portrait Manipulation

Previous methods have dealt with discrete manipulation of facial attribu...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.