Safe Semi-Supervised Learning of Sum-Product Networks

by   Martin Trapp, et al.

In several domains obtaining class annotations is expensive while at the same time unlabelled data are abundant. While most semi-supervised approaches enforce restrictive assumptions on the data distribution, recent work has managed to learn semi-supervised models in a non-restrictive regime. However, so far such approaches have only been proposed for linear models. In this work, we introduce semi-supervised parameter learning for Sum-Product Networks (SPNs). SPNs are deep probabilistic models admitting inference in linear time in number of network edges. Our approach has several advantages, as it (1) allows generative and discriminative semi-supervised learning, (2) guarantees that adding unlabelled data can increase, but not degrade, the performance (safe), and (3) is computationally efficient and does not enforce restrictive assumptions on the data distribution. We show on a variety of data sets that safe semi-supervised learning with SPNs is competitive compared to state-of-the-art and can lead to a better generative and discriminative objective value than a purely supervised approach.


page 1

page 2

page 3

page 4


RSSL: Semi-supervised Learning in R

In this paper, we introduce a package for semi-supervised learning resea...

Don't fear the unlabelled: safe deep semi-supervised learning via simple debiasing

Semi supervised learning (SSL) provides an effective means of leveraging...

Video Violence Recognition and Localization using a Semi-Supervised Hard-Attention Model

Empowering automated violence monitoring and surveillance systems amid t...

Hybrid Models with Deep and Invertible Features

We propose a neural hybrid model consisting of a linear model defined on...

Deep Learning with Sets and Point Clouds

We introduce a simple permutation equivariant layer for deep learning wi...

A Probabilistic Framework for Discriminative and Neuro-Symbolic Semi-Supervised Learning

In semi-supervised learning (SSL), a rule to predict labels y for data x...

Semi-Supervised Learning -- A Statistical Physics Approach

We present a novel approach to semi-supervised learning which is based o...

Code Repositories

Please sign up or login with your details

Forgot password? Click here to reset