Matching Distributions via Optimal Transport for Semi-Supervised Learning

12/04/2020
by   Fariborz Taherkhani, et al.
0

Semi-Supervised Learning (SSL) approaches have been an influential framework for the usage of unlabeled data when there is not a sufficient amount of labeled data available over the course of training. SSL methods based on Convolutional Neural Networks (CNNs) have recently provided successful results on standard benchmark tasks such as image classification. In this work, we consider the general setting of SSL problem where the labeled and unlabeled data come from the same underlying probability distribution. We propose a new approach that adopts an Optimal Transport (OT) technique serving as a metric of similarity between discrete empirical probability measures to provide pseudo-labels for the unlabeled data, which can then be used in conjunction with the initial labeled data to train the CNN model in an SSL manner. We have evaluated and compared our proposed method with state-of-the-art SSL algorithms on standard datasets to demonstrate the superiority and effectiveness of our SSL algorithm.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/11/2022

DoubleMatch: Improving Semi-Supervised Learning with Self-Supervision

Following the success of supervised learning, semi-supervised learning (...
research
12/03/2018

Clinical Document Classification Using Labeled and Unlabeled Data Across Hospitals

Reviewing radiology reports in emergency departments is an essential but...
research
09/03/2022

Meta-Learning with Less Forgetting on Large-Scale Non-Stationary Task Distributions

The paradigm of machine intelligence moves from purely supervised learni...
research
08/27/2023

Pruning the Unlabeled Data to Improve Semi-Supervised Learning

In the domain of semi-supervised learning (SSL), the conventional approa...
research
10/01/2021

Label Propagation Through Optimal Transport

In this paper, we tackle the transductive semi-supervised learning probl...
research
07/03/2022

NP-Match: When Neural Processes meet Semi-Supervised Learning

Semi-supervised learning (SSL) has been widely explored in recent years,...
research
06/28/2015

Neural Simpletrons - Minimalistic Directed Generative Networks for Learning with Few Labels

Classifiers for the semi-supervised setting often combine strong supervi...

Please sign up or login with your details

Forgot password? Click here to reset