FMGNN: Fused Manifold Graph Neural Network

04/03/2023
by   Cheng Deng, et al.
0

Graph representation learning has been widely studied and demonstrated effectiveness in various graph tasks. Most existing works embed graph data in the Euclidean space, while recent works extend the embedding models to hyperbolic or spherical spaces to achieve better performance on graphs with complex structures, such as hierarchical or ring structures. Fusing the embedding from different manifolds can further take advantage of the embedding capabilities over different graph structures. However, existing embedding fusion methods mostly focus on concatenating or summing up the output embeddings, without considering interacting and aligning the embeddings of the same vertices on different manifolds, which can lead to distortion and impression in the final fusion results. Besides, it is also challenging to fuse the embeddings of the same vertices from different coordinate systems. In face of these challenges, we propose the Fused Manifold Graph Neural Network (FMGNN), a novel GNN architecture that embeds graphs into different Riemannian manifolds with interaction and alignment among these manifolds during training and fuses the vertex embeddings through the distances on different manifolds between vertices and selected landmarks, geometric coresets. Our experiments demonstrate that FMGNN yields superior performance over strong baselines on the benchmarks of node classification and link prediction tasks.

READ FULL TEXT

page 5

page 10

research
02/20/2020

Computationally Tractable Riemannian Manifolds for Graph Embeddings

Representing graphs as sets of node embeddings in certain curved Riemann...
research
07/10/2023

Improving Heterogeneous Graph Learning with Weighted Mixed-Curvature Product Manifold

In graph representation learning, it is important that the complex geome...
research
07/15/2020

Are Hyperbolic Representations in Graphs Created Equal?

Recently there was an increasing interest in applications of graph neura...
research
11/08/2020

DyERNIE: Dynamic Evolution of Riemannian Manifold Embeddings for Temporal Knowledge Graph Completion

There has recently been increasing interest in learning representations ...
research
10/09/2020

Conformal retrofitting via Riemannian manifolds: distilling task-specific graphs into pretrained embeddings

Pretrained (language) embeddings are versatile, task-agnostic feature re...
research
09/19/2022

Dual-Geometric Space Embedding Model for Two-View Knowledge Graphs

Two-view knowledge graphs (KGs) jointly represent two components: an ont...
research
06/09/2021

Symmetric Spaces for Graph Embeddings: A Finsler-Riemannian Approach

Learning faithful graph representations as sets of vertex embeddings has...

Please sign up or login with your details

Forgot password? Click here to reset