Bidirectional Mapping Generative Adversarial Networks for Brain MR to PET Synthesis

08/08/2020
by   Shengye Hu, et al.
0

Fusing multi-modality medical images, such as MR and PET, can provide various anatomical or functional information about human body. But PET data is always unavailable due to different reasons such as cost, radiation, or other limitations. In this paper, we propose a 3D end-to-end synthesis network, called Bidirectional Mapping Generative Adversarial Networks (BMGAN), where image contexts and latent vector are effectively used and jointly optimized for brain MR-to-PET synthesis. Concretely, a bidirectional mapping mechanism is designed to embed the semantic information of PET images into the high dimensional latent space. And the 3D DenseU-Net generator architecture and the extensive objective functions are further utilized to improve the visual quality of synthetic results. The most appealing part is that the proposed method can synthesize the perceptually realistic PET images while preserving the diverse brain structures of different subjects. Experimental results demonstrate that the performance of the proposed method outperforms other competitive cross-modality synthesis methods in terms of quantitative measures, qualitative displays, and classification evaluation.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 4

page 7

page 8

page 10

05/02/2020

Multi-Modality Generative Adversarial Networks with Tumor Consistency Loss for Brain MR Image Synthesis

Magnetic Resonance (MR) images of different modalities can provide compl...
07/20/2021

3D-StyleGAN: A Style-Based Generative Adversarial Network for Generative Modeling of Three-Dimensional Medical Images

Image synthesis via Generative Adversarial Networks (GANs) of three-dime...
10/26/2020

Geometrically Matched Multi-source Microscopic Image Synthesis Using Bidirectional Adversarial Networks

Microscopic images from different modality can provide more complete exp...
10/13/2021

DeepVecFont: Synthesizing High-quality Vector Fonts via Dual-modality Learning

Automatic font generation based on deep learning has aroused a lot of in...
09/22/2019

LoGANv2: Conditional Style-Based Logo Generation with Generative Adversarial Networks

Domains such as logo synthesis, in which the data has a high degree of m...
09/25/2019

mustGAN: Multi-Stream Generative Adversarial Networks for MR Image Synthesis

Multi-contrast MRI protocols increase the level of morphological informa...
07/05/2018

PortraitGAN for Flexible Portrait Manipulation

Previous methods have dealt with discrete manipulation of facial attribu...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.