Shape-consistent Generative Adversarial Networks for multi-modal Medical segmentation maps

01/24/2022
by   Leo Segre, et al.
0

Image translation across domains for unpaired datasets has gained interest and great improvement lately. In medical imaging, there are multiple imaging modalities, with very different characteristics. Our goal is to use cross-modality adaptation between CT and MRI whole cardiac scans for semantic segmentation. We present a segmentation network using synthesised cardiac volumes for extremely limited datasets. Our solution is based on a 3D cross-modality generative adversarial network to share information between modalities and generate synthesized data using unpaired datasets. Our network utilizes semantic segmentation to improve generator shape consistency, thus creating more realistic synthesised volumes to be used when re-training the segmentation network. We show that improved segmentation can be achieved on small datasets when using spatial augmentations to improve a generative adversarial network. These augmentations improve the generator capabilities, thus enhancing the performance of the Segmentor. Using only 16 CT and 16 MRI cardiovascular volumes, improved results are shown over other segmentation methods while using the suggested architecture.

READ FULL TEXT
research
02/27/2018

Translating and Segmenting Multimodal Medical Volumes with Cycle- and Shape-Consistency Generative Adversarial Network

Synthesized medical images have several important applications, e.g., as...
research
09/14/2019

Automated Multiclass Cardiac Volume Segmentation and Model Generation

Many strides have been made in semantic segmentation of multiple classes...
research
06/11/2019

PAN: Projective Adversarial Network for Medical Image Segmentation

Adversarial learning has been proven to be effective for capturing long-...
research
02/11/2021

Segmentation-Renormalized Deep Feature Modulation for Unpaired Image Harmonization

Deep networks are now ubiquitous in large-scale multi-center imaging stu...
research
07/29/2021

Swap-Free Fat-Water Separation in Dixon MRI using Conditional Generative Adversarial Networks

Dixon MRI is widely used for body composition studies. Current processin...
research
08/09/2018

Overcoming Missing and Incomplete Modalities with Generative Adversarial Networks for Building Footprint Segmentation

The integration of information acquired with different modalities, spati...
research
09/18/2019

CrackGAN: A Labor-Light Crack Detection Approach Using Industrial Pavement Images Based on Generative Adversarial Learning

Fully convolutional network is a powerful tool for per-pixel semantic se...

Please sign up or login with your details

Forgot password? Click here to reset