DeepAI AI Chat
Log In Sign Up

A Deep Latent Space Model for Graph Representation Learning

by   Hanxuan Yang, et al.

Graph representation learning is a fundamental problem for modeling relational data and benefits a number of downstream applications. Traditional Bayesian-based graph models and recent deep learning based GNN either suffer from impracticability or lack interpretability, thus combined models for undirected graphs have been proposed to overcome the weaknesses. As a large portion of real-world graphs are directed graphs (of which undirected graphs are special cases), in this paper, we propose a Deep Latent Space Model (DLSM) for directed graphs to incorporate the traditional latent variable based generative model into deep learning frameworks. Our proposed model consists of a graph convolutional network (GCN) encoder and a stochastic decoder, which are layer-wise connected by a hierarchical variational auto-encoder architecture. By specifically modeling the degree heterogeneity using node random factors, our model possesses better interpretability in both community structure and degree heterogeneity. For fast inference, the stochastic gradient variational Bayes (SGVB) is adopted using a non-iterative recognition model, which is much more scalable than traditional MCMC-based methods. The experiments on real-world datasets show that the proposed model achieves the state-of-the-art performances on both link prediction and community detection tasks while learning interpretable node embeddings. The source code is available at


page 1

page 2

page 3

page 4


Variational Graph Auto-Encoders

We introduce the variational graph auto-encoder (VGAE), a framework for ...

Directed Graph Auto-Encoders

We introduce a new class of auto-encoders for directed graphs, motivated...

Stochastic Graph Recurrent Neural Network

Representation learning over graph structure data has been widely studie...

Knowledge Generation – Variational Bayes on Knowledge Graphs

This thesis is a proof of concept for the potential of Variational Auto-...

Stochastic Blockmodels meet Graph Neural Networks

Stochastic blockmodels (SBM) and their variants, e.g., mixed-membership ...

RWR-GAE: Random Walk Regularization for Graph Auto Encoders

Node embeddings have become an ubiquitous technique for representing gra...

Differential equation and probability inspired graph neural networks for latent variable learning

Probabilistic theory and differential equation are powerful tools for th...