Ordered Subgraph Aggregation Networks

06/22/2022
by   Chendi Qian, et al.
8

Numerous subgraph-enhanced graph neural networks (GNNs) have emerged recently, provably boosting the expressive power of standard (message-passing) GNNs. However, there is a limited understanding of how these approaches relate to each other and to the Weisfeiler–Leman hierarchy. Moreover, current approaches either use all subgraphs of a given size, sample them uniformly at random, or use hand-crafted heuristics instead of learning to select subgraphs in a data-driven manner. Here, we offer a unified way to study such architectures by introducing a theoretical framework and extending the known expressivity results of subgraph-enhanced GNNs. Concretely, we show that increasing subgraph size always increases the expressive power and develop a better understanding of their limitations by relating them to the established k-𝖶𝖫 hierarchy. In addition, we explore different approaches for learning to sample subgraphs using recent methods for backpropagating through complex discrete probability distributions. Empirically, we study the predictive performance of different subgraph-enhanced GNNs, showing that our data-driven architectures increase prediction accuracy on standard benchmark datasets compared to non-data-driven subgraph-enhanced graph neural networks while reducing computation time.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/22/2022

Understanding and Extending Subgraph GNNs by Rethinking Their Symmetries

Subgraph GNNs are a recent class of expressive Graph Neural Networks (GN...
research
04/14/2023

Combining Stochastic Explainers and Subgraph Neural Networks can Increase Expressivity and Interpretability

Subgraph-enhanced graph neural networks (SGNN) can increase the expressi...
research
09/16/2022

Explainability in subgraphs-enhanced Graph Neural Networks

Recently, subgraphs-enhanced Graph Neural Networks (SGNNs) have been int...
research
02/14/2023

A Complete Expressiveness Hierarchy for Subgraph GNNs via Subgraph Weisfeiler-Lehman Tests

Recently, subgraph GNNs have emerged as an important direction for devel...
research
10/06/2021

Equivariant Subgraph Aggregation Networks

Message-passing neural networks (MPNNs) are the leading architecture for...
research
02/28/2022

Algorithm and System Co-design for Efficient Subgraph-based Graph Representation Learning

Subgraph-based graph representation learning (SGRL) has been recently pr...
research
02/03/2022

Learning Mechanically Driven Emergent Behavior with Message Passing Neural Networks

From designing architected materials to connecting mechanical behavior a...

Please sign up or login with your details

Forgot password? Click here to reset