Posterior Consistency of Semi-Supervised Regression on Graphs

07/25/2020
by   Andrea L. Bertozzi, et al.
4

Graph-based semi-supervised regression (SSR) is the problem of estimating the value of a function on a weighted graph from its values (labels) on a small subset of the vertices. This paper is concerned with the consistency of SSR in the context of classification, in the setting where the labels have small noise and the underlying graph weighting is consistent with well-clustered nodes. We present a Bayesian formulation of SSR in which the weighted graph defines a Gaussian prior, using a graph Laplacian, and the labeled data defines a likelihood. We analyze the rate of contraction of the posterior measure around the ground truth in terms of parameters that quantify the small label error and inherent clustering in the graph. We obtain bounds on the rates of contraction and illustrate their sharpness through numerical experiments. The analysis also gives insight into the choice of hyperparameters that enter the definition of the prior.

READ FULL TEXT

page 16

page 17

page 26

page 27

page 28

page 29

research
08/26/2020

Posterior Contraction Rates for Graph-Based Semi-Supervised Classification

This paper studies Bayesian nonparametric estimation of a binary regress...
research
06/18/2019

Consistency of semi-supervised learning algorithms on graphs: Probit and one-hot methods

Graph-based semi-supervised learning is the problem of propagating label...
research
09/27/2020

Analysis of label noise in graph-based semi-supervised learning

In machine learning, one must acquire labels to help supervise a model t...
research
06/19/2020

Poisson Learning: Graph Based Semi-Supervised Learning At Very Low Label Rates

We propose a new framework, called Poisson learning, for graph based sem...
research
08/27/2020

A Consistent Diffusion-Based Algorithm for Semi-Supervised Classification on Graphs

Semi-supervised classification on graphs aims at assigning labels to all...
research
01/29/2019

A maximum principle argument for the uniform convergence of graph Laplacian regressors

We study asymptotic consistency guarantees for a non-parametric regressi...
research
09/28/2015

Theoretical Analysis of the Optimal Free Responses of Graph-Based SFA for the Design of Training Graphs

Slow feature analysis (SFA) is an unsupervised learning algorithm that e...

Please sign up or login with your details

Forgot password? Click here to reset