Free Lunch for Surgical Video Understanding by Distilling Self-Supervisions

05/19/2022
by   Xinpeng Ding, et al.
6

Self-supervised learning has witnessed great progress in vision and NLP; recently, it also attracted much attention to various medical imaging modalities such as X-ray, CT, and MRI. Existing methods mostly focus on building new pretext self-supervision tasks such as reconstruction, orientation, and masking identification according to the properties of medical images. However, the publicly available self-supervision models are not fully exploited. In this paper, we present a powerful yet efficient self-supervision framework for surgical video understanding. Our key insight is to distill knowledge from publicly available models trained on large generic datasets4 to facilitate the self-supervised learning of surgical videos. To this end, we first introduce a semantic-preserving training scheme to obtain our teacher model, which not only contains semantics from the publicly available models, but also can produce accurate knowledge for surgical data. Besides training with only contrastive learning, we also introduce a distillation objective to transfer the rich learned information from the teacher model to self-supervised learning on surgical data. Extensive experiments on two surgical phase recognition benchmarks show that our framework can significantly improve the performance of existing self-supervised learning methods. Notably, our framework demonstrates a compelling advantage under a low-data regime. Our code is available at https://github.com/xmed-lab/DistillingSelf.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/14/2020

Learning Semantics-enriched Representation via Self-discovery, Self-classification, and Self-restoration

Medical images are naturally associated with rich semantics about the hu...
research
03/31/2023

Automatic Detection of Out-of-body Frames in Surgical Videos for Privacy Protection Using Self-supervised Learning and Minimal Labels

Endoscopic video recordings are widely used in minimally invasive robot-...
research
05/14/2021

Evaluating the Robustness of Self-Supervised Learning in Medical Imaging

Self-supervision has demonstrated to be an effective learning strategy w...
research
07/20/2022

Tailoring Self-Supervision for Supervised Learning

Recently, it is shown that deploying a proper self-supervision is a pros...
research
05/18/2022

Global Contrast Masked Autoencoders Are Powerful Pathological Representation Learners

Based on digital whole slide scanning technique, artificial intelligence...
research
07/27/2023

Federated Model Aggregation via Self-Supervised Priors for Highly Imbalanced Medical Image Classification

In the medical field, federated learning commonly deals with highly imba...
research
07/16/2020

Self-Supervised Nuclei Segmentation in Histopathological Images Using Attention

Segmentation and accurate localization of nuclei in histopathological im...

Please sign up or login with your details

Forgot password? Click here to reset