Bayesian Semi-supervised Learning with Graph Gaussian Processes

09/12/2018
by   Yin Cheng Ng, et al.
0

We propose a data-efficient Gaussian process-based Bayesian approach to the semi-supervised learning problem on graphs. The proposed model shows extremely competitive performance when compared to the state-of-the-art graph neural networks on semi-supervised learning benchmark experiments, and outperforms the neural networks in active learning experiments where labels are scarce. Furthermore, the model does not require a validation data set for early stopping to control over-fitting. Our model can be viewed as an instance of empirical distribution regression weighted locally by network connectivity. We further motivate the intuitive construction of the model with a Bayesian linear model interpretation where the node features are filtered by an operator related to the graph Laplacian. The method can be easily implemented by adapting off-the-shelf scalable variational inference algorithms for Gaussian processes.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/15/2019

Algorithms for ℓ_p-based semi-supervised learning on graphs

We develop fast algorithms for solving the variational and game-theoreti...
research
10/18/2021

A-Optimal Active Learning

In this work we discuss the problem of active learning. We present an ap...
research
02/12/2023

Graph Neural Network-Inspired Kernels for Gaussian Processes in Semi-Supervised Learning

Gaussian processes (GPs) are an attractive class of machine learning mod...
research
02/26/2020

Infinitely Wide Graph Convolutional Networks: Semi-supervised Learning via Gaussian Processes

Graph convolutional neural networks (GCNs) have recently demonstrated pr...
research
09/03/2015

Semi-described and semi-supervised learning with Gaussian processes

Propagating input uncertainty through non-linear Gaussian process (GP) m...
research
11/28/2022

Transductive Kernels for Gaussian Processes on Graphs

Kernels on graphs have had limited options for node-level problems. To a...
research
10/16/2018

Multimodal Deep Gaussian Processes

We propose a novel Bayesian approach to modelling multimodal data genera...

Please sign up or login with your details

Forgot password? Click here to reset