Log In Sign Up

Task Decomposition and Synchronization for Semantic Biomedical Image Segmentation

by   Xuhua Ren, et al.

Semantic segmentation is essentially important to biomedical image analysis. Many recent works mainly focus on integrating the Fully Convolutional Network (FCN) architecture with sophisticated convolution implementation and deep supervision. In this paper, we propose to decompose the single segmentation task into three subsequent sub-tasks, including (1) pixel-wise image segmentation, (2) prediction of the class labels of the objects within the image, and (3) classification of the scene the image belonging to. While these three sub-tasks are trained to optimize their individual loss functions of different perceptual levels, we propose to let them interact by the task-task context ensemble. Moreover, we propose a novel sync-regularization to penalize the deviation between the outputs of the pixel-wise segmentation and the class prediction tasks. These effective regularizations help FCN utilize context information comprehensively and attain accurate semantic segmentation, even though the number of the images for training may be limited in many biomedical applications. We have successfully applied our framework to three diverse 2D/3D medical image datasets, including Robotic Scene Segmentation Challenge 18 (ROBOT18), Brain Tumor Segmentation Challenge 18 (BRATS18), and Retinal Fundus Glaucoma Challenge (REFUGE18). We have achieved top-tier performance in all three challenges.


page 1

page 2

page 4

page 6

page 7


Multi-Level Contextual Network for Biomedical Image Segmentation

Accurate and reliable image segmentation is an essential part of biomedi...

Learning With Context Feedback Loop for Robust Medical Image Segmentation

Deep learning has successfully been leveraged for medical image segmenta...

Star Shape Prior in Fully Convolutional Networks for Skin Lesion Segmentation

Semantic segmentation is an important preliminary step towards automatic...

Neuron Segmentation Using Deep Complete Bipartite Networks

In this paper, we consider the problem of automatically segmenting neuro...

Pixel Relationships-based Regularizer for Retinal Vessel Image Segmentation

The task of image segmentation is to classify each pixel in the image ba...

Orthogonal Ensemble Networks for Biomedical Image Segmentation

Despite the astonishing performance of deep-learning based approaches fo...