Exponentially Improving the Complexity of Simulating the Weisfeiler-Lehman Test with Graph Neural Networks

11/06/2022
by   Anders Aamand, et al.
0

Recent work shows that the expressive power of Graph Neural Networks (GNNs) in distinguishing non-isomorphic graphs is exactly the same as that of the Weisfeiler-Lehman (WL) graph test. In particular, they show that the WL test can be simulated by GNNs. However, those simulations involve neural networks for the 'combine' function of size polynomial or even exponential in the number of graph nodes n, as well as feature vectors of length linear in n. We present an improved simulation of the WL test on GNNs with exponentially lower complexity. In particular, the neural network implementing the combine function in each node has only a polylogarithmic number of parameters in n, and the feature vectors exchanged by the nodes of GNN consists of only O(log n) bits. We also give logarithmic lower bounds for the feature vector length and the size of the neural networks, showing the (near)-optimality of our construction.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/24/2022

A Topological characterisation of Weisfeiler-Leman equivalence classes

Graph Neural Networks (GNNs) are learning models aimed at processing gra...
research
04/08/2020

Improving Expressivity of Graph Neural Networks

We propose a Graph Neural Network with greater expressive power than com...
research
06/12/2021

Graph Neural Networks with Local Graph Parameters

Various recent proposals increase the distinguishing power of Graph Neur...
research
07/10/2023

On the power of graph neural networks and the role of the activation function

In this article we present new results about the expressivity of Graph N...
research
11/06/2022

SE(3)-equivariant Graph Neural Networks for Learning Glassy Liquids Representations

Within the glassy liquids community, the use of Machine Learning (ML) to...
research
03/08/2023

The Descriptive Complexity of Graph Neural Networks

We analyse the power of graph neural networks (GNNs) in terms of Boolean...
research
01/21/2020

EdgeNets:Edge Varying Graph Neural Networks

Driven by the outstanding performance of neural networks in the structur...

Please sign up or login with your details

Forgot password? Click here to reset