TricycleGAN: Unsupervised Image Synthesis and Segmentation Based on Shape Priors

by   Umaseh Sivanesan, et al.

Medical image segmentation is routinely performed to isolate regions of interest, such as organs and lesions. Currently, deep learning is the state of the art for automatic segmentation, but is usually limited by the need for supervised training with large datasets that have been manually segmented by trained clinicians. The goal of semi-superised and unsupervised image segmentation is to greatly reduce, or even eliminate, the need for training data and therefore to minimze the burden on clinicians when training segmentation models. To this end we introduce a novel network architecture for capable of unsupervised and semi-supervised image segmentation called TricycleGAN. This approach uses three generative models to learn translations between medical images and segmentation maps using edge maps as an intermediate step. Distinct from other approaches based on generative networks, TricycleGAN relies on shape priors rather than colour and texture priors. As such, it is particularly well-suited for several domains of medical imaging, such as ultrasound imaging, where commonly used visual cues may be absent. We present experiments with TricycleGAN on a clinical dataset of kidney ultrasound images and the benchmark ISIC 2018 skin lesion dataset.



There are no comments yet.


page 5

page 6

page 12

page 14

page 19


Unsupervised Medical Image Segmentation with Adversarial Networks: From Edge Diagrams to Segmentation Maps

We develop and approach to unsupervised semantic medical image segmentat...

Generative ScatterNet Hybrid Deep Learning (G-SHDL) Network with Structural Priors for Semantic Image Segmentation

This paper proposes a generative ScatterNet hybrid deep learning (G-SHDL...

Spatially Dependent U-Nets: Highly Accurate Architectures for Medical Imaging Segmentation

In clinical practice, regions of interest in medical imaging often need ...

Y-net: Biomedical Image Segmentation and Clustering

We propose a deep clustering architecture alongside image segmentation f...

Breast lesion segmentation in ultrasound images with limited annotated data

Ultrasound (US) is one of the most commonly used imaging modalities in b...

Unsupervised Approaches for Out-Of-Distribution Dermoscopic Lesion Detection

There are limited works showing the efficacy of unsupervised Out-of-Dist...

Subsequent Boundary Distance Regression and Pixelwise Classification Networks for Automatic Kidney Segmentation in Ultrasound Images

It remains challenging to automatically segment kidneys in clinical ultr...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.