EDEN: A Plug-in Equivariant Distance Encoding to Beyond the 1-WL Test

11/19/2022
by   Chang Liu, et al.
0

The message-passing scheme is the core of graph representation learning. While most existing message-passing graph neural networks (MPNNs) are permutation-invariant in graph-level representation learning and permutation-equivariant in node- and edge-level representation learning, their expressive power is commonly limited by the 1-Weisfeiler-Lehman (1-WL) graph isomorphism test. Recently proposed expressive graph neural networks (GNNs) with specially designed complex message-passing mechanisms are not practical. To bridge the gap, we propose a plug-in Equivariant Distance ENcoding (EDEN) for MPNNs. EDEN is derived from a series of interpretable transformations on the graph's distance matrix. We theoretically prove that EDEN is permutation-equivariant for all level graph representation learning, and we empirically illustrate that EDEN's expressive power can reach up to the 3-WL test. Extensive experiments on real-world datasets show that combining EDEN with conventional GNNs surpasses recent advanced GNNs.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/16/2021

Graph Convolutional Networks with Dual Message Passing for Subgraph Isomorphism Counting and Matching

Graph neural networks (GNNs) and message passing neural networks (MPNNs)...
research
11/09/2020

Graph Neural Network with Automorphic Equivalence Filters

Graph neural network (GNN) has recently been established as an effective...
research
04/04/2021

Uniting Heterogeneity, Inductiveness, and Efficiency for Graph Representation Learning

With the ubiquitous graph-structured data in various applications, model...
research
05/08/2023

From Relational Pooling to Subgraph GNNs: A Universal Framework for More Expressive Graph Neural Networks

Relational pooling is a framework for building more expressive and permu...
research
06/26/2020

Building powerful and equivariant graph neural networks with message-passing

Message-passing has proved to be an effective way to design graph neural...
research
02/11/2023

Is Distance Matrix Enough for Geometric Deep Learning?

Graph Neural Networks (GNNs) are often used for tasks involving the geom...
research
10/28/2022

Generalized Laplacian Positional Encoding for Graph Representation Learning

Graph neural networks (GNNs) are the primary tool for processing graph-s...

Please sign up or login with your details

Forgot password? Click here to reset