Few-shot 3D Multi-modal Medical Image Segmentation using Generative Adversarial Learning

10/29/2018
by   Arnab Kumar Mondal, et al.
3

We address the problem of segmenting 3D multi-modal medical images in scenarios where very few labeled examples are available for training. Leveraging the recent success of adversarial learning for semi-supervised segmentation, we propose a novel method based on Generative Adversarial Networks (GANs) to train a segmentation model with both labeled and unlabeled images. The proposed method prevents over-fitting by learning to discriminate between true and fake patches obtained by a generator network. Our work extends current adversarial learning approaches, which focus on 2D single-modality images, to the more challenging context of 3D volumes of multiple modalities. The proposed method is evaluated on the problem of segmenting brain MRI from the iSEG-2017 and MRBrainS 2013 datasets. Significant performance improvement is reported, compared to state-of-art segmentation networks trained in a fully-supervised manner. In addition, our work presents a comprehensive analysis of different GAN architectures for semi-supervised segmentation, showing recent techniques like feature matching to yield a higher performance than conventional adversarial training approaches. Our code is publicly available at https://github.com/arnab39/FewShot_GAN-Unet3D

READ FULL TEXT

page 1

page 2

page 7

page 8

page 9

08/25/2021

Duo-SegNet: Adversarial Dual-Views for Semi-Supervised Medical Image Segmentation

Segmentation of images is a long-standing challenge in medical AI. This ...
08/27/2023

Bi-Modality Medical Image Synthesis Using Semi-Supervised Sequential Generative Adversarial Networks

In this paper, we propose a bi-modality medical image synthesis approach...
03/31/2023

Comparing Adversarial and Supervised Learning for Organs at Risk Segmentation in CT images

Organ at Risk (OAR) segmentation from CT scans is a key component of the...
07/19/2020

Symbiotic Adversarial Learning for Attribute-based Person Search

Attribute-based person search is in significant demand for applications ...
05/14/2022

Voxel-wise Adversarial Semi-supervised Learning for Medical Image Segmentation

Semi-supervised learning for medical image segmentation is an important ...
01/26/2018

Classification of sparsely labeled spatio-temporal data through semi-supervised adversarial learning

In recent years, Generative Adversarial Networks (GAN) have emerged as a...

Code Repositories

FewShot_GAN-Unet3D

Tensorflow implementation of our paper: Few-shot 3D Multi-modal Medical Image Segmentation using Generative Adversarial Learning


view repo

Please sign up or login with your details

Forgot password? Click here to reset