Graph and graphon neural network stability

10/23/2020
by   Luana Ruiz, et al.
0

Graph neural networks (GNNs) are learning architectures that rely on knowledge of the graph structure to generate meaningful representations of large-scale network data. GNN stability is thus important as in real-world scenarios there are typically uncertainties associated with the graph. We analyze GNN stability using kernel objects called graphons. Graphons are both limits of convergent graph sequences and generating models for deterministic and stochastic graphs. Building upon the theory of graphon signal processing, we define graphon neural networks and analyze their stability to graphon perturbations. We then extend this analysis by interpreting the graphon neural network as a generating model for GNNs on deterministic and stochastic graphs instantiated from the original and perturbed graphons. We observe that GNNs are stable to graphon perturbations with a stability bound that decreases asymptotically with the size of the graph. This asymptotic behavior is further demonstrated in an experiment of movie recommendation.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/07/2021

Training Stable Graph Neural Networks Through Constrained Learning

Graph Neural Networks (GNN) rely on graph convolutions to learn features...
research
12/14/2021

Robust Graph Neural Networks via Probabilistic Lipschitz Constraints

Graph neural networks (GNNs) have recently been demonstrated to perform ...
research
11/13/2022

Learning Stable Graph Neural Networks via Spectral Regularization

Stability of graph neural networks (GNNs) characterizes how GNNs react t...
research
06/19/2021

Stability of Graph Convolutional Neural Networks to Stochastic Perturbations

Graph convolutional neural networks (GCNNs) are nonlinear processing too...
research
02/03/2020

Gated Graph Recurrent Neural Networks

Graph processes exhibit a temporal structure determined by the sequence ...
research
09/03/2020

Algebraic Neural Networks: Stability to Deformations

In this work we study the stability of algebraic neural networks (AlgNNs...
research
10/10/2021

Stability of Neural Networks on Manifolds to Relative Perturbations

Graph Neural Networks (GNNs) show impressive performance in many practic...

Please sign up or login with your details

Forgot password? Click here to reset