Semi-supervised classification of radiology images with NoTeacher: A Teacher that is not Mean

08/10/2021
by   Balagopal Unnikrishnan, et al.
0

Deep learning models achieve strong performance for radiology image classification, but their practical application is bottlenecked by the need for large labeled training datasets. Semi-supervised learning (SSL) approaches leverage small labeled datasets alongside larger unlabeled datasets and offer potential for reducing labeling cost. In this work, we introduce NoTeacher, a novel consistency-based SSL framework which incorporates probabilistic graphical models. Unlike Mean Teacher which maintains a teacher network updated via a temporal ensemble, NoTeacher employs two independent networks, thereby eliminating the need for a teacher network. We demonstrate how NoTeacher can be customized to handle a range of challenges in radiology image classification. Specifically, we describe adaptations for scenarios with 2D and 3D inputs, uni and multi-label classification, and class distribution mismatch between labeled and unlabeled portions of the training data. In realistic empirical evaluations on three public benchmark datasets spanning the workhorse modalities of radiology (X-Ray, CT, MRI), we show that NoTeacher achieves over 90-95 fully supervised AUROC with less than 5-15 outperforms established SSL methods with minimal hyperparameter tuning, and has implications as a principled and practical option for semisupervised learning in radiology applications.

READ FULL TEXT

page 15

page 17

page 30

research
03/05/2021

Self-supervised Mean Teacher for Semi-supervised Chest X-ray Classification

The training of deep learning models generally requires a large amount o...
research
09/05/2022

Consistency-Based Semi-supervised Evidential Active Learning for Diagnostic Radiograph Classification

Deep learning approaches achieve state-of-the-art performance for classi...
research
12/29/2022

MagicNet: Semi-Supervised Multi-Organ Segmentation via Magic-Cube Partition and Recovery

We propose a novel teacher-student model for semi-supervised multi-organ...
research
03/06/2017

Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning results

The recently proposed Temporal Ensembling has achieved state-of-the-art ...
research
07/08/2020

Consistency Regularization with Generative Adversarial Networks for Semi-Supervised Image Classification

Generative Adversarial Networks (GANs) based semi-supervised learning (S...
research
07/12/2018

Deep semi-supervised segmentation with weight-averaged consistency targets

Recently proposed techniques for semi-supervised learning such as Tempor...
research
03/24/2021

Hetero-Modal Learning and Expansive Consistency Constraints for Semi-Supervised Detection from Multi-Sequence Data

Lesion detection serves a critical role in early diagnosis and has been ...

Please sign up or login with your details

Forgot password? Click here to reset