Knowledge Distillation from Cross Teaching Teachers for Efficient Semi-Supervised Abdominal Organ Segmentation in CT

11/11/2022
by   Jae Won Choi, et al.
0

For more clinical applications of deep learning models for medical image segmentation, high demands on labeled data and computational resources must be addressed. This study proposes a coarse-to-fine framework with two teacher models and a student model that combines knowledge distillation and cross teaching, a consistency regularization based on pseudo-labels, for efficient semi-supervised learning. The proposed method is demonstrated on the abdominal multi-organ segmentation task in CT images under the MICCAI FLARE 2022 challenge, with mean Dice scores of 0.8429 and 0.8520 in the validation and test sets, respectively.

READ FULL TEXT
research
07/05/2022

ACT-Net: Asymmetric Co-Teacher Network for Semi-supervised Memory-efficient Medical Image Segmentation

While deep models have shown promising performance in medical image segm...
research
02/24/2023

A Knowledge Distillation framework for Multi-Organ Segmentation of Medaka Fish in Tomographic Image

Morphological atlases are an important tool in organismal studies, and m...
research
12/09/2021

Semi-Supervised Medical Image Segmentation via Cross Teaching between CNN and Transformer

Recently, deep learning with Convolutional Neural Networks (CNNs) and Tr...
research
07/20/2023

Cluster-aware Semi-supervised Learning: Relational Knowledge Distillation Provably Learns Clustering

Despite the empirical success and practical significance of (relational)...
research
08/15/2021

CPNet: Cycle Prototype Network for Weakly-supervised 3D Renal Compartments Segmentation on CT Images

Renal compartment segmentation on CT images targets on extracting the 3D...
research
12/01/2017

A 3D Coarse-to-Fine Framework for Automatic Pancreas Segmentation

In this paper, we adopt 3D CNNs to segment the pancreas in CT images. Al...
research
07/23/2022

Combining Hybrid Architecture and Pseudo-label for Semi-supervised Abdominal Organ Segmentation

Abdominal organ segmentation has many important clinical applications, s...

Please sign up or login with your details

Forgot password? Click here to reset