A Fractional Graph Laplacian Approach to Oversmoothing

05/22/2023
by   Sohir Maskey, et al.
0

Graph neural networks (GNNs) have shown state-of-the-art performances in various applications. However, GNNs often struggle to capture long-range dependencies in graphs due to oversmoothing. In this paper, we generalize the concept of oversmoothing from undirected to directed graphs. To this aim, we extend the notion of Dirichlet energy by considering a directed symmetrically normalized Laplacian. As vanilla graph convolutional networks are prone to oversmooth, we adopt a neural graph ODE framework. Specifically, we propose fractional graph Laplacian neural ODEs, which describe non-local dynamics. We prove that our approach allows propagating information between distant nodes while maintaining a low probability of long-distance jumps. Moreover, we show that our method is more flexible with respect to the convergence of the graph's Dirichlet energy, thereby mitigating oversmoothing. We conduct extensive experiments on synthetic and real-world graphs, both directed and undirected, demonstrating our method's versatility across diverse graph homophily levels. Our code is available at https://github.com/RPaolino/fLode .

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/04/2020

Rethinking Graph Regularization For Graph Neural Networks

The graph Laplacian regularization term is usually used in semi-supervis...
research
09/01/2022

MSGNN: A Spectral Graph Neural Network Based on a Novel Magnetic Signed Laplacian

Signed and directed networks are ubiquitous in real-world applications. ...
research
05/31/2022

Principle of Relevant Information for Graph Sparsification

Graph sparsification aims to reduce the number of edges of a graph while...
research
12/20/2019

Laplacian Flow Dynamics on Geometric Graphs for Anatomical Modeling of Cerebrovascular Networks

Generating computational anatomical models of cerebrovascular networks i...
research
01/05/2020

Adaptive fractional order graph neural network

This paper proposes adaptive fractional order graph neural network (AFGN...
research
02/22/2022

PyTorch Geometric Signed Directed: A Survey and Software on Graph Neural Networks for Signed and Directed Graphs

Signed networks are ubiquitous in many real-world applications (e.g., so...
research
10/11/2021

Nonlocal diffusion of variable order on graphs

Some aspects of nonlocal dynamics on directed and undirected networks fo...

Please sign up or login with your details

Forgot password? Click here to reset