Improving the Long-Range Performance of Gated Graph Neural Networks

07/19/2020
by   Denis Lukovnikov, et al.
0

Many popular variants of graph neural networks (GNNs) that are capable of handling multi-relational graphs may suffer from vanishing gradients. In this work, we propose a novel GNN architecture based on the Gated Graph Neural Network with an improved ability to handle long-range dependencies in multi-relational graphs. An experimental analysis on different synthetic tasks demonstrates that the proposed architecture outperforms several popular GNN models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/22/2022

EIGNN: Efficient Infinite-Depth Graph Neural Networks

Graph neural networks (GNNs) are widely used for modelling graph-structu...
research
01/21/2022

Representing Long-Range Context for Graph Neural Networks with Global Attention

Graph neural networks are powerful architectures for structured datasets...
research
07/13/2020

Beyond Graph Neural Networks with Lifted Relational Neural Networks

We demonstrate a declarative differentiable programming framework based ...
research
03/10/2021

Graph Neural Networks Inspired by Classical Iterative Algorithms

Despite the recent success of graph neural networks (GNN), common archit...
research
02/16/2021

ReGraphX: NoC-enabled 3D Heterogeneous ReRAM Architecture for Training Graph Neural Networks

Graph Neural Network (GNN) is a variant of Deep Neural Networks (DNNs) o...
research
07/01/2023

Re-Think and Re-Design Graph Neural Networks in Spaces of Continuous Graph Diffusion Functionals

Graph neural networks (GNNs) are widely used in domains like social netw...
research
03/06/2023

Wind Turbine Gearbox Fault Detection Based on Sparse Filtering and Graph Neural Networks

The wind energy industry has been experiencing tremendous growth and con...

Please sign up or login with your details

Forgot password? Click here to reset