DeepAI
Log In Sign Up

Graph Attention Networks with Positional Embeddings

05/09/2021
by   Liheng Ma, et al.
0

Graph Neural Networks (GNNs) are deep learning methods which provide the current state of the art performance in node classification tasks. GNNs often assume homophily – neighboring nodes having similar features and labels–, and therefore may not be at their full potential when dealing with non-homophilic graphs. In this work, we focus on addressing this limitation and enable Graph Attention Networks (GAT), a commonly used variant of GNNs, to explore the structural information within each graph locality. Inspired by the positional encoding in the Transformers, we propose a framework, termed Graph Attentional Networks with Positional Embeddings (GAT-POS), to enhance GATs with positional embeddings which capture structural and positional information of the nodes in the graph. In this framework, the positional embeddings are learned by a model predictive of the graph context, plugged into an enhanced GAT architecture, which is able to leverage both the positional and content information of each node. The model is trained jointly to optimize for the task of node classification as well as the task of predicting graph context. Experimental results show that GAT-POS reaches remarkable improvement compared to strong GNN baselines and recent structural embedding enhanced GNNs on non-homophilic graphs.

READ FULL TEXT

page 1

page 2

page 3

page 4

03/15/2022

Incorporating Heterophily into Graph Neural Networks for Graph Classification

Graph neural networks (GNNs) often assume strong homophily in graphs, se...
02/23/2021

Dynamic Labeling for Unlabeled Graph Neural Networks

Existing graph neural networks (GNNs) largely rely on node embeddings, w...
06/30/2021

Curvature Graph Neural Network

Graph neural networks (GNNs) have achieved great success in many graph-b...
04/08/2020

Improving Expressivity of Graph Neural Networks

We propose a Graph Neural Network with greater expressive power than com...
08/26/2021

Web Image Context Extraction with Graph Neural Networks and Sentence Embeddings on the DOM tree

Web Image Context Extraction (WICE) consists in obtaining the textual in...
02/11/2019

Deep Node Ranking: an Algorithm for Structural Network Embedding and End-to-End Classification

Complex networks are used as an abstraction for systems modeling in phys...
01/10/2022

Graph Representation Learning for Multi-Task Settings: a Meta-Learning Approach

Graph Neural Networks (GNNs) have become the state-of-the-art method for...