Improving Graph Neural Network Expressivity via Subgraph Isomorphism Counting

06/16/2020
by   Giorgos Bouritsas, et al.
16

While Graph Neural Networks (GNNs) have achieved remarkable results in a variety of applications, recent studies exposed important shortcomings in their ability to capture the structure of the underlying graph. It has been shown that the expressive power of standard GNNs is bounded by the Weisfeiler-Lehman (WL) graph isomorphism test, from which they inherit proven limitations such as the inability to detect and count graph substructures. On the other hand, there is significant empirical evidence, e.g. in network science and bioinformatics, that substructures are often informative for downstream tasks, suggesting that it is desirable to design GNNs capable of leveraging this important source of information. To this end, we propose a novel topologically-aware message passing scheme based on subgraph isomorphism counting. We show that our architecture allows incorporating domain-specific inductive biases and that it is strictly more expressive than the WL test. Importantly, in contrast to recent works on the expressivity of GNNs, we do not attempt to adhere to the WL hierarchy; this allows us to retain multiple attractive properties of standard GNNs such as locality and linear complexity, while being able to disambiguate even hard instances of graph isomorphism. We extensively evaluate our method on graph classification and regression tasks and show state-of-the-art results on multiple datasets including molecular graphs and social networks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/10/2023

Distance-Restricted Folklore Weisfeiler-Leman GNNs with Provable Cycle Counting Power

The ability of graph neural networks (GNNs) to count certain graph subst...
research
08/16/2023

The Expressive Power of Graph Neural Networks: A Survey

Graph neural networks (GNNs) are effective machine learning models for m...
research
08/16/2023

Expressivity of Graph Neural Networks Through the Lens of Adversarial Robustness

We perform the first adversarial robustness study into Graph Neural Netw...
research
09/22/2022

Memory-Augmented Graph Neural Networks: A Neuroscience Perspective

Graph neural networks (GNNs) have been extensively used for many domains...
research
02/10/2020

Can graph neural networks count substructures?

The ability to detect and count certain substructures in graphs is impor...
research
10/06/2020

Directional Graph Networks

In order to overcome the expressive limitations of graph neural networks...
research
02/07/2023

Learning to Count Isomorphisms with Graph Neural Networks

Subgraph isomorphism counting is an important problem on graphs, as many...

Please sign up or login with your details

Forgot password? Click here to reset