Billion-scale semi-supervised learning for image classification

05/02/2019
by   I. Zeki Yalniz, et al.
0

This paper presents a study of semi-supervised learning with large convolutional networks. We propose a pipeline, based on a teacher/student paradigm, that leverages a large collection of unlabelled images (up to 1 billion). Our main goal is to improve the performance for a given target architecture, like ResNet-50 or ResNext. We provide an extensive analysis of the success factors of our approach, which leads us to formulate some recommendations to produce high-accuracy models for image classification with semi-supervised learning. As a result, our approach brings important gains to standard architectures for image, video and fine-grained classification. For instance, by leveraging one billion unlabelled images, our learned vanilla ResNet-50 achieves 81.2

READ FULL TEXT

page 1

page 4

10/30/2021

HIERMATCH: Leveraging Label Hierarchies for Improving Semi-Supervised Learning

Semi-supervised learning approaches have emerged as an active area of re...
04/01/2021

A Realistic Evaluation of Semi-Supervised Learning for Fine-Grained Classification

We evaluate the effectiveness of semi-supervised learning (SSL) on a rea...
02/17/2019

A semi-supervised deep residual network for mode detection in Wi-Fi signals

Due to their ubiquitous and pervasive nature, Wi-Fi networks have the po...
10/29/2018

Accelerating System Log Processing by Semi-supervised Learning: A Technical Report

There is an increasing need for more automated system-log analysis tools...
08/17/2017

Deep Learning at 15PF: Supervised and Semi-Supervised Classification for Scientific Data

This paper presents the first, 15-PetaFLOP Deep Learning system for solv...
05/19/2022

Semi-Supervised Learning for Image Classification using Compact Networks in the BioMedical Context

The development of mobile and on the edge applications that embed deep c...
07/13/2021

Learning a Discriminant Latent Space with Neural Discriminant Analysis

Discriminative features play an important role in image and object class...