Stability and Generalization Capabilities of Message Passing Graph Neural Networks

02/01/2022
by   Sohir Maskey, et al.
3

Message passing neural networks (MPNN) have seen a steep rise in popularity since their introduction as generalizations of convolutional neural networks to graph structured data, and are now considered state-of-the-art tools for solving a large variety of graph-focused problems. We study the generalization capabilities of MPNNs in graph classification. We assume that graphs of different classes are sampled from different random graph models. Based on this data distribution, we derive a non-asymptotic bound on the generalization gap between the empirical and statistical loss, that decreases to zero as the graphs become larger. This is proven by showing that a MPNN, applied on a graph, approximates the MPNN applied on the geometric model that the graph discretizes.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/21/2023

Convergence of Message Passing Graph Neural Networks with Generic Aggregation On Large Random Graphs

We study the convergence of message passing graph neural networks on ran...
research
05/25/2023

A graphon-signal analysis of graph neural networks

We present an approach for analyzing message passing graph neural networ...
research
05/30/2022

OOD Link Prediction Generalization Capabilities of Message-Passing GNNs in Larger Test Graphs

This work provides the first theoretical study on the ability of graph M...
research
02/09/2023

Generalization in Graph Neural Networks: Improved PAC-Bayesian Bounds on Graph Diffusion

Graph neural networks are widely used tools for graph prediction tasks. ...
research
12/09/2022

Robust Graph Representation Learning via Predictive Coding

Predictive coding is a message-passing framework initially developed to ...
research
02/21/2022

1-WL Expressiveness Is (Almost) All You Need

It has been shown that a message passing neural networks (MPNNs), a popu...
research
05/17/2023

Optimality of Message-Passing Architectures for Sparse Graphs

We study the node classification problem on feature-decorated graphs in ...

Please sign up or login with your details

Forgot password? Click here to reset