Interpolation Consistency Training for Semi-Supervised Learning

03/09/2019
by   Vikas Verma, et al.
10

We introduce Interpolation Consistency Training (ICT), a simple and computation efficient algorithm for training Deep Neural Networks in the semi-supervised learning paradigm. ICT encourages the prediction at an interpolation of unlabeled points to be consistent with the interpolation of the predictions at those points. In classification problems, ICT moves the decision boundary to low-density regions of the data distribution. Our experiments show that ICT achieves state-of-the-art performance when applied to standard neural network architectures on the CIFAR-10 and SVHN benchmark datasets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/16/2021

SelfMatch: Combining Contrastive Self-Supervision and Consistency for Semi-Supervised Learning

This paper introduces SelfMatch, a semi-supervised learning method that ...
research
01/24/2019

Semi-Supervised Semantic Matching

Convolutional neural networks (CNNs) have been successfully applied to s...
research
04/19/2021

Epsilon Consistent Mixup: An Adaptive Consistency-Interpolation Tradeoff

In this paper we propose ϵ-Consistent Mixup (ϵmu). ϵmu is a data-based s...
research
09/18/2022

Distributed Semi-supervised Fuzzy Regression with Interpolation Consistency Regularization

Recently, distributed semi-supervised learning (DSSL) algorithms have sh...
research
10/28/2022

When does mixup promote local linearity in learned representations?

Mixup is a regularization technique that artificially produces new sampl...
research
06/13/2021

A baseline for semi-supervised learning of efficient semantic segmentation models

Semi-supervised learning is especially interesting in the dense predicti...
research
09/28/2022

Increasing the Accuracy of a Neural Network Using Frequency Selective Mesh-to-Grid Resampling

Neural networks are widely used for almost any task of recognizing image...

Please sign up or login with your details

Forgot password? Click here to reset