DropGNN: Random Dropouts Increase the Expressiveness of Graph Neural Networks

11/11/2021
by   Pál András Papp, et al.
0

This paper studies Dropout Graph Neural Networks (DropGNNs), a new approach that aims to overcome the limitations of standard GNN frameworks. In DropGNNs, we execute multiple runs of a GNN on the input graph, with some of the nodes randomly and independently dropped in each of these runs. Then, we combine the results of these runs to obtain the final result. We prove that DropGNNs can distinguish various graph neighborhoods that cannot be separated by message passing GNNs. We derive theoretical bounds for the number of runs required to ensure a reliable distribution of dropouts, and we prove several properties regarding the expressive capabilities and limits of DropGNNs. We experimentally validate our theoretical findings on expressiveness. Furthermore, we show that DropGNNs perform competitively on established GNN benchmarks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/08/2020

Random Features Strengthen Graph Neural Networks

Graph neural networks (GNNs) are powerful machine learning models for va...
research
05/25/2020

Variance of Longest Run Duration in a Random Bitstring

We continue an earlier study, starting with unconstrained n-bitstrings, ...
research
07/06/2019

What graph neural networks cannot learn: depth vs width

This paper studies the capacity limits of graph neural networks (GNN). R...
research
05/24/2022

Asynchronous Neural Networks for Learning in Graphs

This paper studies asynchronous message passing (AMP), a new paradigm fo...
research
03/02/2023

Technical report: Graph Neural Networks go Grammatical

This paper proposes a new GNN design strategy. This strategy relies on C...
research
03/01/2021

A Biased Graph Neural Network Sampler with Near-Optimal Regret

Graph neural networks (GNN) have recently emerged as a vehicle for apply...
research
06/08/2023

If At First You Don't Succeed: Extended Monitorability through Multiple Executions

This paper investigates the observational capabilities of monitors that ...

Please sign up or login with your details

Forgot password? Click here to reset