Cross-modality Knowledge Transfer for Prostate Segmentation from CT Scans

08/26/2019
by   Yucheng Liu, et al.
4

Creating large scale high-quality annotations is a known challenge in medical imaging. In this work, based on the CycleGAN algorithm, we propose leveraging annotations from one modality to be useful in other modalities. More specifically, the proposed algorithm creates highly realistic synthetic CT images (SynCT) from prostate MR images using unpaired data sets. By using SynCT images (without segmentation labels) and MR images (with segmentation labels available), we have trained a deep segmentation network for precise delineation of prostate from real CT scans. For the generator in our CycleGAN, the cycle consistency term is used to guarantee that SynCT shares the identical manually-drawn, high-quality masks originally delineated on MR images. Further, we introduce a cost function based on structural similarity index (SSIM) to improve the anatomical similarity between real and synthetic images. For segmentation followed by the SynCT generation from CycleGAN, automatic delineation is achieved through a 2.5D Residual U-Net. Quantitative evaluation demonstrates comparable segmentation results between our SynCT and radiologist drawn masks for real CT images, solving an important problem in medical image segmentation field when ground truth annotations are not available for the modality of interest.

READ FULL TEXT

page 3

page 7

research
10/15/2018

SynSeg-Net: Synthetic Segmentation Without Target Modality Ground Truth

A key limitation of deep convolutional neural networks (DCNN) based imag...
research
10/17/2019

Organ At Risk Segmentation with Multiple Modality

With the development of image segmentation in computer vision, biomedica...
research
07/30/2023

Structure-Preserving Synthesis: MaskGAN for Unpaired MR-CT Translation

Medical image synthesis is a challenging task due to the scarcity of pai...
research
06/27/2022

Context-Aware Transformers For Spinal Cancer Detection and Radiological Grading

This paper proposes a novel transformer-based model architecture for med...
research
05/13/2022

Leveraging Global Binary Masks for Structure Segmentation in Medical Images

Deep learning (DL) models for medical image segmentation are highly infl...
research
01/02/2020

Synthetic vascular structure generation for unsupervised pre-training in CTA segmentation tasks

Large enough computed tomography (CT) data sets to train supervised deep...
research
07/14/2021

Self-Supervised Multi-Modal Alignment for Whole Body Medical Imaging

This paper explores the use of self-supervised deep learning in medical ...

Please sign up or login with your details

Forgot password? Click here to reset