Pseudo-Poincaré: A Unification Framework for Euclidean and Hyperbolic Graph Neural Networks

06/09/2022
by   Mehrdad Khatir, et al.
0

Hyperbolic neural networks have recently gained significant attention due to their promising results on several graph problems including node classification and link prediction. The primary reason for this success is the effectiveness of the hyperbolic space in capturing the inherent hierarchy of graph datasets. However, they are limited in terms of generalization, scalability, and have inferior performance when it comes to non-hierarchical datasets. In this paper, we take a completely orthogonal perspective for modeling hyperbolic networks. We use Poincaré disk to model the hyperbolic geometry and also treat it as if the disk itself is a tangent space at origin. This enables us to replace non-scalable Möbius gyrovector operations with an Euclidean approximation, and thus simplifying the entire hyperbolic model to a Euclidean model cascaded with a hyperbolic normalization function. Our approach does not adhere to Möbius math, yet it still works in the Riemannian manifold, hence we call it Pseudo-Poincaré framework. We applied our non-linear hyperbolic normalization to the current state-of-the-art homogeneous and multi-relational graph networks and demonstrate significant improvements in performance compared to both Euclidean and hyperbolic counterparts. The primary impact of this work lies in its ability to capture hierarchical features in the Euclidean space, and thus, can replace hyperbolic networks without loss in performance metrics while simultaneously leveraging the power of Euclidean networks such as interpretability and efficient execution of various model components.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/03/2023

Node-Specific Space Selection via Localized Geometric Hyperbolicity in Graph Neural Networks

Many graph neural networks have been developed to learn graph representa...
research
05/31/2021

Fully Hyperbolic Neural Networks

Hyperbolic neural networks have shown great potential for modeling compl...
research
06/07/2022

Towards Scalable Hyperbolic Neural Networks using Taylor Series Approximations

Hyperbolic networks have shown prominent improvements over their Euclide...
research
01/05/2019

Poincaré Wasserstein Autoencoder

This work presents a reformulation of the recently proposed Wasserstein ...
research
07/15/2020

Are Hyperbolic Representations in Graphs Created Equal?

Recently there was an increasing interest in applications of graph neura...
research
02/28/2022

Hyperbolic Graph Neural Networks: A Review of Methods and Applications

Graph neural networks generalize conventional neural networks to graph-s...
research
03/24/2023

Poincaré ResNet

This paper introduces an end-to-end residual network that operates entir...

Please sign up or login with your details

Forgot password? Click here to reset