A Probabilistic Framework for Discriminative and Neuro-Symbolic Semi-Supervised Learning

06/10/2020
by   Carl Allen, et al.
0

In semi-supervised learning (SSL), a rule to predict labels y for data x is learned from labelled data (x^l,y^l) and unlabelled samples x^u. Strong progress has been made by combining a variety of methods, some of which pertain to p(x), e.g. data augmentation that generates artificial samples from true x; whilst others relate to model outputs p(y|x), e.g. regularising predictions on unlabelled data to minimise entropy or induce mutual exclusivity. Focusing on the latter, we fill a gap in the standard text by introducing a unifying probabilistic model for discriminative semi-supervised learning, mirroring that for classical generative methods. We show that several SSL methods can be theoretically justified under our model as inducing approximate priors over predicted parameters of p(y|x). For tasks where labels represent binary attributes, our model leads to a principled approach to neuro-symbolic SSL, bridging the divide between statistical learning and logical rules.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/13/2020

A statistical theory of semi-supervised learning

We currently lack a solid statistical understanding of semi-supervised l...
research
12/05/2022

Rethinking Backdoor Data Poisoning Attacks in the Context of Semi-Supervised Learning

Semi-supervised learning methods can train high-accuracy machine learnin...
research
06/08/2021

LaplaceNet: A Hybrid Energy-Neural Model for Deep Semi-Supervised Classification

Semi-supervised learning has received a lot of recent attention as it al...
research
10/10/2017

Safe Semi-Supervised Learning of Sum-Product Networks

In several domains obtaining class annotations is expensive while at the...
research
07/06/2020

Learning the Prediction Distribution for Semi-Supervised Learning with Normalising Flows

As data volumes continue to grow, the labelling process increasingly bec...
research
09/05/2017

Discriminative Similarity for Clustering and Semi-Supervised Learning

Similarity-based clustering and semi-supervised learning methods separat...
research
05/22/2018

Semi-supervised learning: When and why it works

Semi-supervised learning deals with the problem of how, if possible, to ...

Please sign up or login with your details

Forgot password? Click here to reset