TarGAN: Target-Aware Generative Adversarial Networks for Multi-modality Medical Image Translation

05/19/2021
by   Junxiao Chen, et al.
0

Paired multi-modality medical images, can provide complementary information to help physicians make more reasonable decisions than single modality medical images. But they are difficult to generate due to multiple factors in practice (e.g., time, cost, radiation dose). To address these problems, multi-modality medical image translation has aroused increasing research interest recently. However, the existing works mainly focus on translation effect of a whole image instead of a critical target area or Region of Interest (ROI), e.g., organ and so on. This leads to poor-quality translation of the localized target area which becomes blurry, deformed or even with extra unreasonable textures. In this paper, we propose a novel target-aware generative adversarial network called TarGAN, which is a generic multi-modality medical image translation model capable of (1) learning multi-modality medical image translation without relying on paired data, (2) enhancing quality of target area generation with the help of target area labels. The generator of TarGAN jointly learns mapping at two levels simultaneously - whole image translation mapping and target area translation mapping. These two mappings are interrelated through a proposed crossing loss. The experiments on both quantitative measures and qualitative evaluations demonstrate that TarGAN outperforms the state-of-the-art methods in all cases. Subsequent segmentation task is conducted to demonstrate effectiveness of synthetic images generated by TarGAN in a real-world application. Our code is available at https://github.com/2165998/TarGAN.

READ FULL TEXT

page 2

page 7

10/07/2020

Discriminative Cross-Modal Data Augmentation for Medical Imaging Applications

While deep learning methods have shown great success in medical image an...
07/09/2022

Unsupervised Joint Image Transfer and Uncertainty Quantification using Patch Invariant Networks

Unsupervised image transfer enables intra- and inter-modality transfer f...
06/17/2018

MedGAN: Medical Image Translation using GANs

Image-to-image translation is considered a next frontier in the field of...
12/28/2020

Analysis of Macula on Color Fundus Images Using Heightmap Reconstruction Through Deep Learning

For medical diagnosis based on retinal images, a clear understanding of ...
07/17/2022

Unsupervised Medical Image Translation with Adversarial Diffusion Models

Imputation of missing images via source-to-target modality translation c...
02/23/2021

Uncertainty-aware Generalized Adaptive CycleGAN

Unpaired image-to-image translation refers to learning inter-image-domai...
01/26/2020

Visualisation of Medical Image Fusion and Translation for Accurate Diagnosis of High Grade Gliomas

The medical image fusion combines two or more modalities into a single v...