Renormalized Graph Neural Networks

06/01/2023
by   Francesco Caso, et al.
0

Graph Neural Networks (GNNs) have become essential for studying complex data, particularly when represented as graphs. Their value is underpinned by their ability to reflect the intricacies of numerous areas, ranging from social to biological networks. GNNs can grapple with non-linear behaviors, emerging patterns, and complex connections; these are also typical characteristics of complex systems. The renormalization group (RG) theory has emerged as the language for studying complex systems. It is recognized as the preferred lens through which to study complex systems, offering a framework that can untangle their intricate dynamics. Despite the clear benefits of integrating RG theory with GNNs, no existing methods have ventured into this promising territory. This paper proposes a new approach that applies RG theory to devise a novel graph rewiring to improve GNNs' performance on graph-related tasks. We support our proposal with extensive experiments on standard benchmarks and baselines. The results demonstrate the effectiveness of our method and its potential to remedy the current limitations of GNNs. Finally, this paper marks the beginning of a new research direction. This path combines the theoretical foundations of RG, the magnifying glass of complex systems, with the structural capabilities of GNNs. By doing so, we aim to enhance the potential of GNNs in modeling and unraveling the complexities inherent in diverse systems.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/10/2021

Optimization of Graph Neural Networks: Implicit Acceleration by Skip Connections and More Depth

Graph Neural Networks (GNNs) have been studied through the lens of expre...
research
01/01/2022

Toward the Analysis of Graph Neural Networks

Graph Neural Networks (GNNs) have recently emerged as a robust framework...
research
09/22/2022

Memory-Augmented Graph Neural Networks: A Neuroscience Perspective

Graph neural networks (GNNs) have been extensively used for many domains...
research
02/15/2022

Geometrically Equivariant Graph Neural Networks: A Survey

Many scientific problems require to process data in the form of geometri...
research
06/03/2023

Can Directed Graph Neural Networks be Adversarially Robust?

The existing research on robust Graph Neural Networks (GNNs) fails to ac...
research
01/05/2020

Adaptive fractional order graph neural network

This paper proposes adaptive fractional order graph neural network (AFGN...
research
01/25/2023

E(n)-equivariant Graph Neural Cellular Automata

Cellular automata (CAs) are computational models exhibiting rich dynamic...

Please sign up or login with your details

Forgot password? Click here to reset