Torsion Graph Neural Networks

06/23/2023
by   Cong Shen, et al.
0

Geometric deep learning (GDL) models have demonstrated a great potential for the analysis of non-Euclidian data. They are developed to incorporate the geometric and topological information of non-Euclidian data into the end-to-end deep learning architectures. Motivated by the recent success of discrete Ricci curvature in graph neural network (GNNs), we propose TorGNN, an analytic Torsion enhanced Graph Neural Network model. The essential idea is to characterize graph local structures with an analytic torsion based weight formula. Mathematically, analytic torsion is a topological invariant that can distinguish spaces which are homotopy equivalent but not homeomorphic. In our TorGNN, for each edge, a corresponding local simplicial complex is identified, then the analytic torsion (for this local simplicial complex) is calculated, and further used as a weight (for this edge) in message-passing process. Our TorGNN model is validated on link prediction tasks from sixteen different types of networks and node classification tasks from three types of networks. It has been found that our TorGNN can achieve superior performance on both tasks, and outperform various state-of-the-art models. This demonstrates that analytic torsion is a highly efficient topological invariant in the characterization of graph structures and can significantly boost the performance of GNNs.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/12/2022

EEGNN: Edge Enhanced Graph Neural Networks

Training deep graph neural networks (GNNs) poses a challenging task, as ...
research
06/23/2023

Curvature-enhanced Graph Convolutional Network for Biomolecular Interaction Prediction

Geometric deep learning has demonstrated a great potential in non-Euclid...
research
05/01/2021

Bermuda Triangles: GNNs Fail to Detect Simple Topological Structures

Most graph neural network architectures work by message-passing node vec...
research
05/03/2023

An Exploration of Conditioning Methods in Graph Neural Networks

The flexibility and effectiveness of message passing based graph neural ...
research
11/13/2020

Learning to Drop: Robust Graph Neural Network via Topological Denoising

Graph Neural Networks (GNNs) have shown to be powerful tools for graph a...
research
12/16/2020

A Deep Graph Neural Networks Architecture Design: From Global Pyramid-like Shrinkage Skeleton to Local Topology Link Rewiring

Expressivity plays a fundamental role in evaluating deep neural networks...
research
09/01/2023

Geometric Deep Learning: a Temperature Based Analysis of Graph Neural Networks

We examine a Geometric Deep Learning model as a thermodynamic system tre...

Please sign up or login with your details

Forgot password? Click here to reset