Stability of Manifold Neural Networks to Deformations

06/07/2021
by   Zhiyang Wang, et al.
0

Stability is an important property of graph neural networks (GNNs) which explains their success in many problems of practical interest. Existing GNN stability results depend on the size of the graph, restricting applicability to graphs of moderate size. To understand the stability properties of GNNs on large graphs, we consider neural networks supported on manifolds. These are defined in terms of manifold diffusions mediated by the Laplace-Beltrami (LB) operator and are interpreted as limits of GNNs running on graphs of growing size. We define manifold deformations and show that they lead to perturbations of the manifold's LB operator that consist of an absolute and a relative perturbation term. We then define filters that split the infinite dimensional spectrum of the LB operator in finite partitions, and prove that manifold neural networks (MNNs) with these filters are stable to both, absolute and relative perturbations of the LB operator. Stability results are illustrated numerically in resource allocation problems in wireless networks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/10/2021

Stability of Neural Networks on Manifolds to Relative Perturbations

Graph Neural Networks (GNNs) show impressive performance in many practic...
research
07/08/2022

Stability of Aggregation Graph Neural Networks

In this paper we study the stability properties of aggregation graph neu...
research
05/29/2023

Geometric Graph Filters and Neural Networks: Limit Properties and Discriminability Trade-offs

This paper studies the relationship between a graph neural network (GNN)...
research
10/21/2019

Stability of Graph Neural Networks to Relative Perturbations

Graph neural networks (GNNs), consisting of a cascade of layers applying...
research
05/11/2019

Stability Properties of Graph Neural Networks

Data stemming from networks exhibit an irregular support, whereby each d...
research
07/08/2023

Manifold Filter-Combine Networks

We introduce a class of manifold neural networks (MNNs) that we call Man...
research
03/20/2023

Tangent Bundle Convolutional Learning: from Manifolds to Cellular Sheaves and Back

In this work we introduce a convolution operation over the tangent bundl...

Please sign up or login with your details

Forgot password? Click here to reset