Hyperbolic Curvature Graph Neural Network

12/04/2022
by   Menglin Yang, et al.
0

Hyperbolic space is emerging as a promising learning space for representation learning, owning to its exponential growth volume. Compared with the flat Euclidean space, the curved hyperbolic space is far more ambient and embeddable, particularly for datasets with implicit tree-like architectures, such as hierarchies and power-law distributions. On the other hand, the structure of a real-world network is usually intricate, with some regions being tree-like, some being flat, and others being circular. Directly embedding heterogeneous structural networks into a homogeneous embedding space unavoidably brings inductive biases and distortions. Inspiringly, the discrete curvature can well describe the local structure of a node and its surroundings, which motivates us to investigate the information conveyed by the network topology explicitly in improving geometric learning. To this end, we explore the properties of the local discrete curvature of graph topology and the continuous global curvature of embedding space. Besides, a Hyperbolic Curvature-aware Graph Neural Network, HCGNN, is further proposed. In particular, HCGNN utilizes the discrete curvature to lead message passing of the surroundings and adaptively adjust the continuous curvature simultaneously. Extensive experiments on node classification and link prediction tasks show that the proposed method outperforms various competitive models by a large margin in both high and low hyperbolic graph data. Case studies further illustrate the efficacy of discrete curvature in finding local clusters and alleviating the distortion caused by hyperbolic geometry.

READ FULL TEXT

page 1

page 8

research
10/15/2021

ACE-HGNN: Adaptive Curvature Exploration Hyperbolic Graph Neural Network

Graph Neural Networks (GNNs) have been widely studied in various graph d...
research
03/03/2023

Node-Specific Space Selection via Localized Geometric Hyperbolicity in Graph Neural Networks

Many graph neural networks have been developed to learn graph representa...
research
07/15/2020

Are Hyperbolic Representations in Graphs Created Equal?

Recently there was an increasing interest in applications of graph neura...
research
07/08/2021

Discrete-time Temporal Network Embedding via Implicit Hierarchical Learning in Hyperbolic Space

Representation learning over temporal networks has drawn considerable at...
research
11/08/2022

Hyperbolic Graph Representation Learning: A Tutorial

Graph-structured data are widespread in real-world applications, such as...
research
11/27/2020

Representation of 2D frame less visual space as a neural manifold and its information geometric interpretation

Representation of 2D frame less visual space as neural manifold and its ...
research
07/31/2023

L3DMC: Lifelong Learning using Distillation via Mixed-Curvature Space

The performance of a lifelong learning (L3) model degrades when it is tr...

Please sign up or login with your details

Forgot password? Click here to reset