An application of cascaded 3D fully convolutional networks for medical image segmentation

03/14/2018
by   Holger R. Roth, et al.
0

Recent advances in 3D fully convolutional networks (FCN) have made it feasible to produce dense voxel-wise predictions of volumetric images. In this work, we show that a multi-class 3D FCN trained on manually labeled CT scans of several anatomical structures (ranging from the large organs to thin vessels) can achieve competitive segmentation results, while avoiding the need for handcrafting features or training class-specific models. To this end, we propose a two-stage, coarse-to-fine approach that will first use a 3D FCN to roughly define a candidate region, which will then be used as input to a second 3D FCN. This reduces the number of voxels the second FCN has to classify to 10 organs and vessels. We utilize training and validation sets consisting of 331 clinical CT images and test our models on a completely unseen data collection acquired at a different hospital that includes 150 CT scans, targeting three anatomical organs (liver, spleen, and pancreas). In challenging organs such as the pancreas, our cascaded approach improves the mean Dice score from 68.5 to 82.2 with a 2D FCN method on a separate dataset of 240 CT scans with 18 classes and achieve a significantly higher performance in small organs and vessels. Furthermore, we explore fine-tuning our models to different datasets. Our experiments illustrate the promise and robustness of current 3D FCN based semantic segmentation of medical images, achieving state-of-the-art results. Our code and trained models are available for download: https://github.com/holgerroth/3Dunet_abdomen_cascade.

READ FULL TEXT

page 3

page 7

page 9

page 11

page 15

page 16

page 17

research
12/05/2017

Fully Automatic Segmentation of Lumbar Vertebrae from CT Images using Cascaded 3D Fully Convolutional Networks

We present a method to address the challenging problem of segmentation o...
research
05/17/2017

A deep level set method for image segmentation

This paper proposes a novel image segmentation approachthat integrates f...
research
08/12/2022

Extraction of Pulmonary Airway in CT Scans Using Deep Fully Convolutional Networks

Accurate, automatic and complete extraction of pulmonary airway in medic...
research
07/30/2017

Virtual PET Images from CT Data Using Deep Convolutional Networks: Initial Results

In this work we present a novel system for PET estimation using CT scans...
research
02/02/2021

Atlas-aware ConvNetfor Accurate yet Robust Anatomical Segmentation

Convolutional networks (ConvNets) have achieved promising accuracy for v...
research
06/23/2020

3D Probabilistic Segmentation and Volumetry from 2D projection images

X-Ray imaging is quick, cheap and useful for front-line care assessment ...
research
10/15/2017

Towards Automatic Abdominal Multi-Organ Segmentation in Dual Energy CT using Cascaded 3D Fully Convolutional Network

Automatic multi-organ segmentation of the dual energy computed tomograph...

Please sign up or login with your details

Forgot password? Click here to reset