Leave Graphs Alone: Addressing Over-Squashing without Rewiring

12/13/2022
by   Domenico Tortorella, et al.
0

Recent works have investigated the role of graph bottlenecks in preventing long-range information propagation in message-passing graph neural networks, causing the so-called `over-squashing' phenomenon. As a remedy, graph rewiring mechanisms have been proposed as preprocessing steps. Graph Echo State Networks (GESNs) are a reservoir computing model for graphs, where node embeddings are recursively computed by an untrained message-passing function. In this paper, we show that GESNs can achieve a significantly better accuracy on six heterophilic node classification tasks without altering the graph connectivity, thus suggesting a different route for addressing the over-squashing problem.

READ FULL TEXT

page 3

page 8

research
05/14/2023

Addressing Heterophily in Node Classification with Graph Echo State Networks

Node classification tasks on graphs are addressed via fully-trained deep...
research
02/01/2022

Dimensionality Reduction Meets Message Passing for Graph Node Embeddings

Graph Neural Networks (GNNs) have become a popular approach for various ...
research
11/17/2022

Spatial Graph Convolution Neural Networks for Water Distribution Systems

We investigate the task of missing value estimation in graphs as given b...
research
05/17/2023

Optimality of Message-Passing Architectures for Sparse Graphs

We study the node classification problem on feature-decorated graphs in ...
research
08/06/2022

Oversquashing in GNNs through the lens of information contraction and graph expansion

The quality of signal propagation in message-passing graph neural networ...
research
03/04/2020

PushNet: Efficient and Adaptive Neural Message Passing

Message passing neural networks have recently evolved into a state-of-th...
research
10/24/2020

Pathfinder Discovery Networks for Neural Message Passing

In this work we propose Pathfinder Discovery Networks (PDNs), a method f...

Please sign up or login with your details

Forgot password? Click here to reset