Few-shot 3D Multi-modal Medical Image Segmentation using Generative Adversarial Learning

by   Arnab Kumar Mondal, et al.

We address the problem of segmenting 3D multi-modal medical images in scenarios where very few labeled examples are available for training. Leveraging the recent success of adversarial learning for semi-supervised segmentation, we propose a novel method based on Generative Adversarial Networks (GANs) to train a segmentation model with both labeled and unlabeled images. The proposed method prevents over-fitting by learning to discriminate between true and fake patches obtained by a generator network. Our work extends current adversarial learning approaches, which focus on 2D single-modality images, to the more challenging context of 3D volumes of multiple modalities. The proposed method is evaluated on the problem of segmenting brain MRI from the iSEG-2017 and MRBrainS 2013 datasets. Significant performance improvement is reported, compared to state-of-art segmentation networks trained in a fully-supervised manner. In addition, our work presents a comprehensive analysis of different GAN architectures for semi-supervised segmentation, showing recent techniques like feature matching to yield a higher performance than conventional adversarial training approaches. Our code is publicly available at https://github.com/arnab39/FewShot_GAN-Unet3D


page 1

page 2

page 7

page 8

page 9


Duo-SegNet: Adversarial Dual-Views for Semi-Supervised Medical Image Segmentation

Segmentation of images is a long-standing challenge in medical AI. This ...

Bi-Modality Medical Image Synthesis Using Semi-Supervised Sequential Generative Adversarial Networks

In this paper, we propose a bi-modality medical image synthesis approach...

Comparing Adversarial and Supervised Learning for Organs at Risk Segmentation in CT images

Organ at Risk (OAR) segmentation from CT scans is a key component of the...

Symbiotic Adversarial Learning for Attribute-based Person Search

Attribute-based person search is in significant demand for applications ...

Voxel-wise Adversarial Semi-supervised Learning for Medical Image Segmentation

Semi-supervised learning for medical image segmentation is an important ...

Classification of sparsely labeled spatio-temporal data through semi-supervised adversarial learning

In recent years, Generative Adversarial Networks (GAN) have emerged as a...

Code Repositories


Tensorflow implementation of our paper: Few-shot 3D Multi-modal Medical Image Segmentation using Generative Adversarial Learning

view repo

Please sign up or login with your details

Forgot password? Click here to reset