Graphon Pooling for Reducing Dimensionality of Signals and Convolutional Operators on Graphs

12/15/2022
by   Alejandro Parada-Mayorga, et al.
0

In this paper we propose a pooling approach for convolutional information processing on graphs relying on the theory of graphons and limits of dense graph sequences. We present three methods that exploit the induced graphon representation of graphs and graph signals on partitions of [0, 1]2 in the graphon space. As a result we derive low dimensional representations of the convolutional operators, while a dimensionality reduction of the signals is achieved by simple local interpolation of functions in L2([0, 1]). We prove that those low dimensional representations constitute a convergent sequence of graphs and graph signals, respectively. The methods proposed and the theoretical guarantees that we provide show that the reduced graphs and signals inherit spectral-structural properties of the original quantities. We evaluate our approach with a set of numerical experiments performed on graph neural networks (GNNs) that rely on graphon pooling. We observe that graphon pooling performs significantly better than other approaches proposed in the literature when dimensionality reduction ratios between layers are large. We also observe that when graphon pooling is used we have, in general, less overfitting and lower computational cost.

READ FULL TEXT

page 1

page 2

page 5

research
03/03/2020

Graphon Pooling in Graph Neural Networks

Graph neural networks (GNNs) have been used effectively in different app...
research
10/24/2019

Hierarchical Representation Learning in Graph Neural Networks with Node Decimation Pooling

In graph neural networks (GNNs), pooling operators compute local summari...
research
10/11/2021

Understanding Pooling in Graph Neural Networks

Inspired by the conventional pooling layers in convolutional neural netw...
research
06/11/2015

Spectral Representations for Convolutional Neural Networks

Discrete Fourier transforms provide a significant speedup in the computa...
research
05/10/2023

NervePool: A Simplicial Pooling Layer

For deep learning problems on graph-structured data, pooling layers are ...
research
11/16/2013

Signal Recovery from Pooling Representations

In this work we compute lower Lipschitz bounds of ℓ_p pooling operators ...
research
08/06/2022

Graph Pooling with Maximum-Weight k-Independent Sets

Graph reductions are fundamental when dealing with large scale networks ...

Please sign up or login with your details

Forgot password? Click here to reset