Node2Seq: Towards Trainable Convolutions in Graph Neural Networks

01/06/2021
by   Hao Yuan, et al.
22

Investigating graph feature learning becomes essentially important with the emergence of graph data in many real-world applications. Several graph neural network approaches are proposed for node feature learning and they generally follow a neighboring information aggregation scheme to learn node features. While great performance has been achieved, the weights learning for different neighboring nodes is still less explored. In this work, we propose a novel graph network layer, known as Node2Seq, to learn node embeddings with explicitly trainable weights for different neighboring nodes. For a target node, our method sorts its neighboring nodes via attention mechanism and then employs 1D convolutional neural networks (CNNs) to enable explicit weights for information aggregation. In addition, we propose to incorporate non-local information for feature learning in an adaptive manner based on the attention scores. Experimental results demonstrate the effectiveness of our proposed Node2Seq layer and show that the proposed adaptively non-local information learning can improve the performance of feature learning.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/29/2020

Non-Local Graph Neural Networks

Modern graph neural networks (GNNs) learn node embeddings through multil...
research
05/22/2023

Distributed Learning over Networks with Graph-Attention-Based Personalization

In conventional distributed learning over a network, multiple agents col...
research
03/07/2021

Graph Force Learning

Features representation leverages the great power in network analysis ta...
research
05/16/2020

Graph Neural Networks with Composite Kernels

Learning on graph structured data has drawn increasing interest in recen...
research
06/24/2023

Graph Neural Networks Provably Benefit from Structural Information: A Feature Learning Perspective

Graph neural networks (GNNs) have pioneered advancements in graph repres...
research
08/12/2018

Large-Scale Learnable Graph Convolutional Networks

Convolutional neural networks (CNNs) have achieved great success on grid...
research
04/07/2019

Adaptively Connected Neural Networks

This paper presents a novel adaptively connected neural network (ACNet) ...

Please sign up or login with your details

Forgot password? Click here to reset