Building powerful and equivariant graph neural networks with message-passing

06/26/2020
by   Clément Vignac, et al.
1

Message-passing has proved to be an effective way to design graph neural networks, as it is able to leverage both permutation equivariance and an inductive bias towards learning local structures to achieve good generalization. However, current message-passing architectures have a limited representation power and fail to learn basic topological properties of graphs. We address this problem and propose a new message-passing framework that is powerful while preserving permutation equivariance. Specifically, we propagate unique node identifiers in the form of a one-hot encoding in order to learn a local context around each node. We show that our model is computationally universal in the limit, while also being equivariant. Experimentally, we find our model to be superior at predicting various graph topological properties, opening the way to novel powerful architectures that are both equivariant and computationally efficient.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/19/2022

EDEN: A Plug-in Equivariant Distance Encoding to Beyond the 1-WL Test

The message-passing scheme is the core of graph representation learning....
research
12/12/2019

Coloring graph neural networks for node disambiguation

In this paper, we show that a simple coloring scheme can improve, both t...
research
03/02/2021

Autobahn: Automorphism-based Graph Neural Nets

We introduce Automorphism-based graph neural networks (Autobahn), a new ...
research
05/01/2021

Bermuda Triangles: GNNs Fail to Detect Simple Topological Structures

Most graph neural network architectures work by message-passing node vec...
research
06/09/2021

Breaking the Limits of Message Passing Graph Neural Networks

Since the Message Passing (Graph) Neural Networks (MPNNs) have a linear ...
research
01/07/2018

Covariant Compositional Networks For Learning Graphs

Most existing neural networks for learning graphs address permutation in...
research
12/09/2022

Robust Graph Representation Learning via Predictive Coding

Predictive coding is a message-passing framework initially developed to ...

Please sign up or login with your details

Forgot password? Click here to reset