The Value of Nullspace Tuning Using Partial Label Information

03/17/2020
by   Colin B. Hansen, et al.
0

In semi-supervised learning, information from unlabeled examples is used to improve the model learned from labeled examples. But in some learning problems, partial label information can be inferred from otherwise unlabeled examples and used to further improve the model. In particular, partial label information exists when subsets of training examples are known to have the same label, even though the label itself is missing. By encouraging a model to give the same label to all such examples, we can potentially improve its performance. We call this encouragement Nullspace Tuning because the difference vector between any pair of examples with the same label should lie in the nullspace of a linear model. In this paper, we investigate the benefit of using partial label information using a careful comparison framework over well-characterized public datasets. We show that the additional information provided by partial labels reduces test error over good semi-supervised methods usually by a factor of 2, up to a factor of 5.5 in the best case. We also show that adding Nullspace Tuning to the newer and state-of-the-art MixMatch method decreases its test error by up to a factor of 1.8.

READ FULL TEXT

page 2

page 9

research
05/04/2021

Poisoning the Unlabeled Dataset of Semi-Supervised Learning

Semi-supervised machine learning models learn from a (small) set of labe...
research
10/12/2016

Optimistic Semi-supervised Least Squares Classification

The goal of semi-supervised learning is to improve supervised classifier...
research
07/19/2022

Semi-supervised Predictive Clustering Trees for (Hierarchical) Multi-label Classification

Semi-supervised learning (SSL) is a common approach to learning predicti...
research
10/20/2022

Towards Mitigating the Problem of Insufficient and Ambiguous Supervision in Online Crowdsourcing Annotation

In real-world crowdsourcing annotation systems, due to differences in us...
research
05/28/2022

Rethinking the Setting of Semi-supervised Learning on Graphs

We argue that the present setting of semisupervised learning on graphs m...
research
02/20/2019

Learning with Inadequate and Incorrect Supervision

Practically, we are often in the dilemma that the labeled data at hand a...
research
11/21/2020

SHOT-VAE: Semi-supervised Deep Generative Models With Label-aware ELBO Approximations

Semi-supervised variational autoencoders (VAEs) have obtained strong res...

Please sign up or login with your details

Forgot password? Click here to reset