MI^2GAN: Generative Adversarial Network for Medical Image Domain Adaptation using Mutual Information Constraint

07/22/2020
by   Xinpeng Xie, et al.
0

Domain shift between medical images from multicentres is still an open question for the community, which degrades the generalization performance of deep learning models. Generative adversarial network (GAN), which synthesize plausible images, is one of the potential solutions to address the problem. However, the existing GAN-based approaches are prone to fail at preserving image-objects in image-to-image (I2I) translation, which reduces their practicality on domain adaptation tasks. In this paper, we propose a novel GAN (namely MI^2GAN) to maintain image-contents during cross-domain I2I translation. Particularly, we disentangle the content features from domain information for both the source and translated images, and then maximize the mutual information between the disentangled content features to preserve the image-objects. The proposed MI^2GAN is evaluated on two tasks—polyp segmentation using colonoscopic images and the segmentation of optic disc and cup in fundus images. The experimental results demonstrate that the proposed MI^2GAN can not only generate elegant translated images, but also significantly improve the generalization performance of widely used deep learning networks (e.g., U-Net).

READ FULL TEXT

page 7

page 8

research
06/30/2021

Mutual-GAN: Towards Unsupervised Cross-Weather Adaptation with Mutual Information Constraint

Convolutional neural network (CNN) have proven its success for semantic ...
research
04/17/2020

Generative Adversarial Networks for Video-to-Video Domain Adaptation

Endoscopic videos from multicentres often have different imaging conditi...
research
03/16/2018

Improved Part Segmentation Performance by Optimising Realism of Synthetic Images using Cycle Generative Adversarial Networks

In this paper we report on improved part segmentation performance using ...
research
10/30/2019

The Domain Shift Problem of Medical Image Segmentation and Vendor-Adaptation by Unet-GAN

Convolutional neural network (CNN), in particular the Unet, is a powerfu...
research
06/24/2019

Cross-Domain Conditional Generative Adversarial Networks for Stereoscopic Hyperrealism in Surgical Training

Phantoms for surgical training are able to mimic cutting and suturing pr...
research
01/09/2022

Preserving Domain Private Representation via Mutual Information Maximization

Recent advances in unsupervised domain adaptation have shown that mitiga...
research
07/04/2018

MIXGAN: Learning Concepts from Different Domains for Mixture Generation

In this work, we present an interesting attempt on mixture generation: a...

Please sign up or login with your details

Forgot password? Click here to reset