The expressive power of pooling in Graph Neural Networks

04/04/2023
by   Filippo Maria Bianchi, et al.
0

In Graph Neural Networks (GNNs), hierarchical pooling operators generate a coarser representation of the input data by creating local summaries of the graph structure and its vertex features. Considerable attention has been devoted to studying the expressive power of message-passing (MP) layers in GNNs, while a study on how pooling operators affect the expressivity of a GNN is still lacking. Additionally, despite the recent advances in the design of effective pooling operators, there is not a principled criterion to compare them. Our work aims to fill this gap by providing sufficient conditions for a pooling operator to fully preserve the expressive power of the MP layers before it. These conditions serve as a universal and theoretically-grounded criterion for choosing among existing pooling operators or designing new ones. Based on our theoretical findings, we reviewed several existing pooling operators and identified those that fail to satisfy the expressiveness assumptions. Finally, we introduced an experimental setup to empirically measure the expressive power of a GNN equipped with pooling layers, in terms of its capability to perform a graph isomorphism test.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/24/2019

Hierarchical Representation Learning in Graph Neural Networks with Node Decimation Pooling

In graph neural networks (GNNs), pooling operators compute local summari...
research
11/16/2013

Signal Recovery from Pooling Representations

In this work we compute lower Lipschitz bounds of ℓ_p pooling operators ...
research
05/08/2023

From Relational Pooling to Subgraph GNNs: A Universal Framework for More Expressive Graph Neural Networks

Relational pooling is a framework for building more expressive and permu...
research
03/19/2023

The Graph feature fusion technique for speaker recognition based on wav2vec2.0 framework

Pre-trained wav2vec2.0 model has been proved its effectiveness for speak...
research
04/10/2021

Pyramidal Reservoir Graph Neural Network

We propose a deep Graph Neural Network (GNN) model that alternates two t...
research
11/06/2022

SE(3)-equivariant Graph Neural Networks for Learning Glassy Liquids Representations

Within the glassy liquids community, the use of Machine Learning (ML) to...
research
12/06/2020

Counting Substructures with Higher-Order Graph Neural Networks: Possibility and Impossibility Results

While massage passing based Graph Neural Networks (GNNs) have become inc...

Please sign up or login with your details

Forgot password? Click here to reset