S^4L: Self-Supervised Semi-Supervised Learning

by   Xiaohua Zhai, et al.

This work tackles the problem of semi-supervised learning of image classifiers. Our main insight is that the field of semi-supervised learning can benefit from the quickly advancing field of self-supervised visual representation learning. Unifying these two approaches, we propose the framework of self-supervised semi-supervised learning (S^4L) and use it to derive two novel semi-supervised image classification methods. We demonstrate the effectiveness of these methods in comparison to both carefully tuned baselines, and existing semi-supervised learning methods. We then show that S^4L and existing semi-supervised methods can be jointly trained, yielding a new state-of-the-art result on semi-supervised ILSVRC-2012 with 10


Self-supervised Semi-supervised Learning for Data Labeling and Quality Evaluation

As the adoption of deep learning techniques in industrial applications g...

Semi-supervised learning made simple with self-supervised clustering

Self-supervised learning models have been shown to learn rich visual rep...

Learning to Impute: A General Framework for Semi-supervised Learning

Recent semi-supervised learning methods have shown to achieve comparable...

RSSL: Semi-supervised Learning in R

In this paper, we introduce a package for semi-supervised learning resea...

Self-supervised Mean Teacher for Semi-supervised Chest X-ray Classification

The training of deep learning models generally requires a large amount o...

Scaling Up Semi-supervised Learning with Unconstrained Unlabelled Data

We propose UnMixMatch, a semi-supervised learning framework which can le...

Semi-Supervised Machine Learning: a Homological Approach

In this paper we describe the mathematical foundations of a new approach...

Please sign up or login with your details

Forgot password? Click here to reset