Unsupervised learning for cross-domain medical image synthesis using deformation invariant cycle consistency networks

08/12/2018
by   Chengjia Wang, et al.
0

Recently, the cycle-consistent generative adversarial networks (CycleGAN) has been widely used for synthesis of multi-domain medical images. The domain-specific nonlinear deformations captured by CycleGAN make the synthesized images difficult to be used for some applications, for example, generating pseudo-CT for PET-MR attenuation correction. This paper presents a deformation-invariant CycleGAN (DicycleGAN) method using deformable convolutional layers and new cycle-consistency losses. Its robustness dealing with data that suffer from domain-specific nonlinear deformations has been evaluated through comparison experiments performed on a multi-sequence brain MR dataset and a multi-modality abdominal dataset. Our method has displayed its ability to generate synthesized data that is aligned with the source while maintaining a proper quality of signal compared to CycleGAN-generated data. The proposed model also obtained comparable performance with CycleGAN when data from the source and target domains are alignable through simple affine transformations.

READ FULL TEXT
research
07/11/2019

FIRE: Unsupervised bi-directional inter-modality registration using deep networks

Inter-modality image registration is an critical preprocessing step for ...
research
11/27/2020

Manipulating Medical Image Translation with Manifold Disentanglement

Medical image translation (e.g. CT to MR) is a challenging task as it re...
research
02/05/2018

Image Synthesis in Multi-Contrast MRI with Conditional Generative Adversarial Networks

Acquiring images of the same anatomy with multiple different contrasts i...
research
07/19/2018

Generative Adversarial Networks for MR-CT Deformable Image Registration

Deformable Image Registration (DIR) of MR and CT images is one of the mo...
research
08/08/2020

Bidirectional Mapping Generative Adversarial Networks for Brain MR to PET Synthesis

Fusing multi-modality medical images, such as MR and PET, can provide va...
research
06/02/2023

An Attentive-based Generative Model for Medical Image Synthesis

Magnetic resonance (MR) and computer tomography (CT) imaging are valuabl...
research
06/27/2022

Diffusion Deformable Model for 4D Temporal Medical Image Generation

Temporal volume images with 3D+t (4D) information are often used in medi...

Please sign up or login with your details

Forgot password? Click here to reset