Non-Local Graph Neural Networks

05/29/2020
by   Meng Liu, et al.
34

Modern graph neural networks (GNNs) learn node embeddings through multilayer local aggregation and achieve great success in applications on assortative graphs. However, tasks on disassortative graphs usually require non-local aggregation. In this work, we propose a simple yet effective non-local aggregation framework with an efficient attention-guided sorting for GNNs. Based on it, we develop various non-local GNNs. We perform thorough experiments to analyze disassortative graph datasets and evaluate our non-local GNNs. Experimental results demonstrate that our non-local GNNs significantly outperform previous state-of-the-art methods on six benchmark datasets of disassortative graphs, in terms of both model performance and efficiency.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/27/2021

Node Embedding using Mutual Information and Self-Supervision based Bi-level Aggregation

Graph Neural Networks (GNNs) learn low dimensional representations of no...
research
06/11/2021

Graph Transformer Networks: Learning Meta-path Graphs to Improve GNNs

Graph Neural Networks (GNNs) have been widely applied to various fields ...
research
01/06/2021

Node2Seq: Towards Trainable Convolutions in Graph Neural Networks

Investigating graph feature learning becomes essentially important with ...
research
11/21/2018

Contextualized Non-local Neural Networks for Sequence Learning

Recently, a large number of neural mechanisms and models have been propo...
research
06/24/2021

Simple Truncated SVD based Model for Node Classification on Heterophilic Graphs

Graph Neural Networks (GNNs) have shown excellent performance on graphs ...
research
05/21/2022

Are Graph Neural Networks Really Helpful for Knowledge Graph Completion?

Knowledge graphs (KGs) facilitate a wide variety of applications due to ...
research
05/17/2023

SIMGA: A Simple and Effective Heterophilous Graph Neural Network with Efficient Global Aggregation

Graph neural networks (GNNs) realize great success in graph learning but...

Please sign up or login with your details

Forgot password? Click here to reset