Asynchronous Neural Networks for Learning in Graphs

05/24/2022
by   Lukas Faber, et al.
0

This paper studies asynchronous message passing (AMP), a new paradigm for applying neural network based learning to graphs. Existing graph neural networks use the synchronous distributed computing model and aggregate their neighbors in each round, which causes problems such as oversmoothing and limits their expressiveness. On the other hand, AMP is based on the asynchronous model, where nodes react to messages of their neighbors individually. We prove that (i) AMP can simulate synchronous GNNs and that (ii) AMP can theoretically distinguish any pair of graphs. We experimentally validate AMP's expressiveness. Further, we show that AMP might be better suited to propagate messages over large distances in graphs and performs well on several graph classification benchmarks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/14/2020

Generalization and Representational Limits of Graph Neural Networks

We address two fundamental questions about graph neural networks (GNNs)....
research
06/27/2023

Asynchronous Algorithmic Alignment with Cocycles

State-of-the-art neural algorithmic reasoners make use of message passin...
research
11/11/2021

DropGNN: Random Dropouts Increase the Expressiveness of Graph Neural Networks

This paper studies Dropout Graph Neural Networks (DropGNNs), a new appro...
research
07/07/2020

A Classification of Weak Asynchronous Models of Distributed Computing

We conduct a systematic study of asynchronous models of distributed comp...
research
11/17/2021

Local Mutual Exclusion for Dynamic, Anonymous, Bounded Memory Message Passing Systems

Mutual exclusion is a classical problem in distributed computing that pr...
research
02/12/2021

Two Sides of the Same Coin: Heterophily and Oversmoothing in Graph Convolutional Neural Networks

Most graph neural networks (GNN) perform poorly in graphs where neighbor...
research
11/30/2017

On Asynchrony and Choreographies

Choreographic Programming is a paradigm for the development of concurren...

Please sign up or login with your details

Forgot password? Click here to reset