Wasserstein Soft Label Propagation on Hypergraphs: Algorithm and Generalization Error Bounds

09/06/2018
by   Tingran Gao, et al.
0

Inspired by recent interests of developing machine learning and data mining algorithms on hypergraphs, we investigate in this paper the semi-supervised learning algorithm of propagating "soft labels" (e.g. probability distributions, class membership scores) over hypergraphs, by means of optimal transportation. Borrowing insights from Wasserstein propagation on graphs [Solomon et al. 2014], we re-formulate the label propagation procedure as a message-passing algorithm, which renders itself naturally to a generalization applicable to hypergraphs through Wasserstein barycenters. Furthermore, in a PAC learning framework, we provide generalization error bounds for propagating one-dimensional distributions on graphs and hypergraphs using 2-Wasserstein distance, by establishing the algorithmic stability of the proposed semi-supervised learning algorithm. These theoretical results also shed new lights upon deeper understandings of the Wasserstein propagation on graphs.

READ FULL TEXT
research
02/04/2019

Generalization Bounds For Unsupervised and Semi-Supervised Learning With Autoencoders

Autoencoders are widely used for unsupervised learning and as a regulari...
research
09/08/2020

Masked Label Prediction: Unified Massage Passing Model for Semi-Supervised Classification

Graph convolutional network (GCN) and label propagation algorithms (LPA)...
research
06/20/2012

Analysis of Semi-Supervised Learning with the Yarowsky Algorithm

The Yarowsky algorithm is a rule-based semi-supervised learning algorith...
research
05/03/2019

Stability and Generalization of Graph Convolutional Neural Networks

Inspired by convolutional neural networks on 1D and 2D data, graph convo...
research
02/20/2016

Context-guided diffusion for label propagation on graphs

Existing approaches for diffusion on graphs, e.g., for label propagation...
research
01/19/2021

A Unifying Generative Model for Graph Learning Algorithms: Label Propagation, Graph Convolutions, and Combinations

Semi-supervised learning on graphs is a widely applicable problem in net...
research
06/09/2021

Learning Domain Invariant Representations by Joint Wasserstein Distance Minimization

Domain shifts in the training data are common in practical applications ...

Please sign up or login with your details

Forgot password? Click here to reset