DeepAI
Log In Sign Up

Lorentzian Graph Convolutional Networks

04/15/2021
by   Yiding Zhang, et al.
0

Graph convolutional networks (GCNs) have received considerable research attention recently. Most GCNs learn the node representations in Euclidean geometry, but that could have a high distortion in the case of embedding graphs with scale-free or hierarchical structure. Recently, some GCNs are proposed to deal with this problem in non-Euclidean geometry, e.g., hyperbolic geometry. Although hyperbolic GCNs achieve promising performance, existing hyperbolic graph operations actually cannot rigorously follow the hyperbolic geometry, which may limit the ability of hyperbolic geometry and thus hurt the performance of hyperbolic GCNs. In this paper, we propose a novel hyperbolic GCN named Lorentzian graph convolutional network (LGCN), which rigorously guarantees the learned node features follow the hyperbolic geometry. Specifically, we rebuild the graph operations of hyperbolic GCNs with Lorentzian version, e.g., the feature transformation and non-linear activation. Also, an elegant neighborhood aggregation method is designed based on the centroid of Lorentzian distance. Moreover, we prove some proposed graph operations are equivalent in different types of hyperbolic geometry, which fundamentally indicates their correctness. Experiments on six datasets show that LGCN performs better than the state-of-the-art methods. LGCN has lower distortion to learn the representation of tree-likeness graphs compared with existing hyperbolic GCNs. We also find that the performance of some hyperbolic GCNs can be improved by simply replacing the graph operations with those we defined in this paper.

READ FULL TEXT
10/28/2019

Hyperbolic Graph Convolutional Neural Networks

Graph convolutional neural networks (GCNs) embed nodes in a graph into E...
04/14/2021

A Hyperbolic-to-Hyperbolic Graph Convolutional Network

Hyperbolic graph convolutional networks (GCNs) demonstrate powerful repr...
12/06/2019

Hyperbolic Graph Attention Network

Graph neural network (GNN) has shown superior performance in dealing wit...
06/24/2014

Saccadic Eye Movements and the Generalized Pareto Distribution

We describe a statistical analysis of the eye tracker measurements in a ...
02/29/2020

Differentiating through the Fréchet Mean

Recent advances in deep representation learning on Riemannian manifolds ...
07/23/2021

Free Hyperbolic Neural Networks with Limited Radii

Non-Euclidean geometry with constant negative curvature, i.e., hyperboli...
05/24/2018

Hyperbolic Attention Networks

We introduce hyperbolic attention networks to endow neural networks with...