MS-KD: Multi-Organ Segmentation with Multiple Binary-Labeled Datasets

08/05/2021
by   Shixiang Feng, et al.
0

Annotating multiple organs in 3D medical images is time-consuming and costly. Meanwhile, there exist many single-organ datasets with one specific organ annotated. This paper investigates how to learn a multi-organ segmentation model leveraging a set of binary-labeled datasets. A novel Multi-teacher Single-student Knowledge Distillation (MS-KD) framework is proposed, where the teacher models are pre-trained single-organ segmentation networks, and the student model is a multi-organ segmentation network. Considering that each teacher focuses on different organs, a region-based supervision method, consisting of logits-wise supervision and feature-wise supervision, is proposed. Each teacher supervises the student in two regions, the organ region where the teacher is considered as an expert and the background region where all teachers agree. Extensive experiments on three public single-organ datasets and a multi-organ dataset have demonstrated the effectiveness of the proposed MS-KD framework.

READ FULL TEXT
research
08/02/2020

Differentiable Feature Aggregation Search for Knowledge Distillation

Knowledge distillation has become increasingly important in model compre...
research
10/19/2018

Improving Fast Segmentation With Teacher-student Learning

Recently, segmentation neural networks have been significantly improved ...
research
04/01/2018

Substitute Teacher Networks: Learning with Almost No Supervision

Learning through experience is time-consuming, inefficient and often bad...
research
12/15/2020

Teach me to segment with mixed supervision: Confident students become masters

Deep segmentation neural networks require large training datasets with p...
research
08/17/2020

Multi-organ Segmentation via Co-training Weight-averaged Models from Few-organ Datasets

Multi-organ segmentation has extensive applications in many clinical app...
research
12/21/2021

Teacher-Student Architecture for Mixed Supervised Lung Tumor Segmentation

Purpose: Automating tasks such as lung tumor localization and segmentati...
research
10/11/2022

From Mimicking to Integrating: Knowledge Integration for Pre-Trained Language Models

Investigating better ways to reuse the released pre-trained language mod...

Please sign up or login with your details

Forgot password? Click here to reset