Relational VAE: A Continuous Latent Variable Model for Graph Structured Data

06/30/2021
by   Charilaos Mylonas, et al.
0

Graph Networks (GNs) enable the fusion of prior knowledge and relational reasoning with flexible function approximations. In this work, a general GN-based model is proposed which takes full advantage of the relational modeling capabilities of GNs and extends these to probabilistic modeling with Variational Bayes (VB). To that end, we combine complementary pre-existing approaches on VB for graph data and propose an approach that relies on graph-structured latent and conditioning variables. It is demonstrated that Neural Processes can also be viewed through the lens of the proposed model. We show applications on the problem of structured probability density modeling for simulated and real wind farm monitoring data, as well as on the meta-learning of simulated Gaussian Process data. We release the source code, along with the simulated datasets.

READ FULL TEXT
research
01/23/2019

Deep Mean Functions for Meta-Learning in Gaussian Processes

Fitting machine learning models in the low-data limit is challenging. Th...
research
09/01/2021

Bayesian data combination model with Gaussian process latent variable model for mixed observed variables under NMAR missingness

In the analysis of observational data in social sciences and businesses,...
research
03/02/2015

A Review of Relational Machine Learning for Knowledge Graphs

Relational machine learning studies methods for the statistical analysis...
research
09/04/2019

Meta Learning with Relational Information for Short Sequences

This paper proposes a new meta-learning method -- named HARMLESS (HAwkes...
research
01/21/2021

Knowledge Generation – Variational Bayes on Knowledge Graphs

This thesis is a proof of concept for the potential of Variational Auto-...
research
04/24/2023

Variational Diffusion Auto-encoder: Deep Latent Variable Model with Unconditional Diffusion Prior

Variational auto-encoders (VAEs) are one of the most popular approaches ...
research
02/06/2014

Variational Inference in Sparse Gaussian Process Regression and Latent Variable Models - a Gentle Tutorial

In this tutorial we explain the inference procedures developed for the s...

Please sign up or login with your details

Forgot password? Click here to reset