Log In Sign Up

Stochastic Graph Recurrent Neural Network

by   Tijin Yan, et al.

Representation learning over graph structure data has been widely studied due to its wide application prospects. However, previous methods mainly focus on static graphs while many real-world graphs evolve over time. Modeling such evolution is important for predicting properties of unseen networks. To resolve this challenge, we propose SGRNN, a novel neural architecture that applies stochastic latent variables to simultaneously capture the evolution in node attributes and topology. Specifically, deterministic states are separated from stochastic states in the iterative process to suppress mutual interference. With semi-implicit variational inference integrated to SGRNN, a non-Gaussian variational distribution is proposed to help further improve the performance. In addition, to alleviate KL-vanishing problem in SGRNN, a simple and interpretable structure is proposed based on the lower bound of KL-divergence. Extensive experiments on real-world datasets demonstrate the effectiveness of the proposed model. Code is available at


Variational Graph Recurrent Neural Networks

Representation learning over graph structured data has been mostly studi...

EvoNet: A Neural Network for Predicting the Evolution of Dynamic Graphs

Neural networks for structured data like graphs have been studied extens...

Semi-Implicit Stochastic Recurrent Neural Networks

Stochastic recurrent neural networks with latent random variables of com...

A Deep Latent Space Model for Graph Representation Learning

Graph representation learning is a fundamental problem for modeling rela...

Graph Generation with Variational Recurrent Neural Network

Generating graph structures is a challenging problem due to the diverse ...

Deep Data Density Estimation through Donsker-Varadhan Representation

Estimating the data density is one of the challenging problems in deep l...

A Statistical Model for Dynamic Networks with Neural Variational Inference

In this paper we propose a statistical model for dynamically evolving ne...