Convergence and Stability of Graph Convolutional Networks on Large Random Graphs

06/02/2020
by   Nicolas Keriven, et al.
2

We study properties of Graph Convolutional Networks (GCNs) by analyzing their behavior on standard models of random graphs, where nodes are represented by random latent variables and edges are drawn according to a similarity kernel. This allows us to overcome the difficulties of dealing with discrete notions such as isomorphisms on very large graphs, by considering instead more natural geometric aspects. We first study the convergence of GCNs to their continuous counterpart as the number of nodes grows. Our results are fully non-asymptotic and are valid for relatively sparse graphs with an average degree that grows logarithmically with the number of nodes. We then analyze the stability of GCNs to small deformations of the random graph model. In contrast to previous studies of stability in discrete settings, our continuous setup allows us to provide more intuitive deformation-based metrics for understanding stability, which have proven useful for explaining the success of convolutional representations on Euclidean domains.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/19/2022

Graph Convolutional Networks from the Perspective of Sheaves and the Neural Tangent Kernel

Graph convolutional networks are a popular class of deep neural network ...
research
03/22/2016

Edge-exchangeable graphs and sparsity

A known failing of many popular random graph models is that the Aldous-H...
research
01/26/2023

Limitless stability for Graph Convolutional Networks

This work establishes rigorous, novel and widely applicable stability gu...
research
05/04/2018

Towards a Spectrum of Graph Convolutional Networks

We present our ongoing work on understanding the limitations of graph co...
research
09/04/2020

LFGCN: Levitating over Graphs with Levy Flights

Due to high utility in many applications, from social networks to blockc...
research
02/13/2020

The Power of Graph Convolutional Networks to Distinguish Random Graph Models: Short Version

Graph convolutional networks (GCNs) are a widely used method for graph r...
research
03/03/2021

On the Importance of Sampling in Learning Graph Convolutional Networks

Graph Convolutional Networks (GCNs) have achieved impressive empirical a...

Please sign up or login with your details

Forgot password? Click here to reset