A Hierarchy of Graph Neural Networks Based on Learnable Local Features

11/13/2019
by   Michael Lingzhi Li, et al.
33

Graph neural networks (GNNs) are a powerful tool to learn representations on graphs by iteratively aggregating features from node neighbourhoods. Many variant models have been proposed, but there is limited understanding on both how to compare different architectures and how to construct GNNs systematically. Here, we propose a hierarchy of GNNs based on their aggregation regions. We derive theoretical results about the discriminative power and feature representation capabilities of each class. Then, we show how this framework can be utilized to systematically construct arbitrarily powerful GNNs. As an example, we construct a simple architecture that exceeds the expressiveness of the Weisfeiler-Lehman graph isomorphism test. We empirically validate our theory on both synthetic and real-world benchmarks, and demonstrate our example's theoretical power translates to strong results on node classification, graph classification, and graph regression tasks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/01/2018

How Powerful are Graph Neural Networks?

Graph Neural Networks (GNNs) for representation learning of graphs broad...
research
10/14/2022

Not All Neighbors Are Worth Attending to: Graph Selective Attention Networks for Semi-supervised Learning

Graph attention networks (GATs) are powerful tools for analyzing graph d...
research
04/25/2023

When Do Graph Neural Networks Help with Node Classification: Investigating the Homophily Principle on Node Distinguishability

Homophily principle, i.e. nodes with the same labels are more likely to ...
research
12/02/2019

Using Laplacian Spectrum as Graph Feature Representation

Graphs possess exotic features like variable size and absence of natural...
research
12/30/2021

Motif Graph Neural Network

Graphs can model complicated interactions between entities, which natura...
research
05/11/2019

Dissecting Graph Neural Networks on Graph Classification

Graph Neural Nets (GNNs) have received increasing attentions, partially ...
research
05/24/2023

What functions can Graph Neural Networks compute on random graphs? The role of Positional Encoding

We aim to deepen the theoretical understanding of Graph Neural Networks ...

Please sign up or login with your details

Forgot password? Click here to reset