Hyperbolic Variational Graph Neural Network for Modeling Dynamic Graphs

04/06/2021
by   Li Sun, et al.
12

Learning representations for graphs plays a critical role in a wide spectrum of downstream applications. In this paper, we summarize the limitations of the prior works in three folds: representation space, modeling dynamics and modeling uncertainty. To bridge this gap, we propose to learn dynamic graph representation in hyperbolic space, for the first time, which aims to infer stochastic node representations. Working with hyperbolic space, we present a novel Hyperbolic Variational Graph Neural Network, referred to as HVGNN. In particular, to model the dynamics, we introduce a Temporal GNN (TGNN) based on a theoretically grounded time encoding approach. To model the uncertainty, we devise a hyperbolic graph variational autoencoder built upon the proposed TGNN to generate stochastic node representations of hyperbolic normal distributions. Furthermore, we introduce a reparameterisable sampling algorithm for the hyperbolic normal distribution to enable the gradient-based learning of HVGNN. Extensive experiments show that HVGNN outperforms state-of-the-art baselines on real-world datasets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/08/2019

A Differentiable Gaussian-like Distribution on Hyperbolic Space for Gradient-Based Learning

Hyperbolic space is a geometry that is known to be well-suited for repre...
research
10/15/2021

ACE-HGNN: Adaptive Curvature Exploration Hyperbolic Graph Neural Network

Graph Neural Networks (GNNs) have been widely studied in various graph d...
research
10/28/2019

Hyperbolic Graph Neural Networks

Learning from graph-structured data is an important task in machine lear...
research
08/30/2022

A Self-supervised Riemannian GNN with Time Varying Curvature for Temporal Graph Learning

Representation learning on temporal graphs has drawn considerable resear...
research
07/08/2021

Discrete-time Temporal Network Embedding via Implicit Hierarchical Learning in Hyperbolic Space

Representation learning over temporal networks has drawn considerable at...
research
12/22/2021

Investigating Neighborhood Modeling and Asymmetry Preservation in Digraph Representation Learning

Graph Neural Networks (GNNs) traditionally exhibit poor performance for ...
research
02/28/2022

Hyperbolic Graph Neural Networks: A Review of Methods and Applications

Graph neural networks generalize conventional neural networks to graph-s...

Please sign up or login with your details

Forgot password? Click here to reset