Just Jump: Dynamic Neighborhood Aggregation in Graph Neural Networks

04/09/2019
by   Matthias Fey, et al.
0

We propose a dynamic neighborhood aggregation (DNA) procedure guided by (multi-head) attention for representation learning on graphs. In contrast to current graph neural networks which follow a simple neighborhood aggregation scheme, our DNA procedure allows for a selective and node-adaptive aggregation of neighboring embeddings of potentially differing locality. In order to avoid overfitting, we propose to control the channel-wise connections between input and output by making use of grouped linear projections. In a number of transductive node-classification experiments, we demonstrate the effectiveness of our approach.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/21/2019

Neighborhood Enlargement in Graph Neural Networks

Graph Neural Network (GNN) is an effective framework for representation ...
research
11/09/2022

Graph Neural Networks with Adaptive Readouts

An effective aggregation of node features into a graph-level representat...
research
06/09/2018

Representation Learning on Graphs with Jumping Knowledge Networks

Recent deep learning approaches for representation learning on graphs fo...
research
11/05/2019

GraphAIR: Graph Representation Learning with Neighborhood Aggregation and Interaction

Graph representation learning is of paramount importance for a variety o...
research
02/25/2022

Equilibrium Aggregation: Encoding Sets via Optimization

Processing sets or other unordered, potentially variable-sized inputs in...
research
01/04/2022

Graph Neural Networks for Double-Strand DNA Breaks Prediction

Double-strand DNA breaks (DSBs) are a form of DNA damage that can cause ...
research
06/03/2021

Learning Representation over Dynamic Graph using Aggregation-Diffusion Mechanism

Representation learning on graphs that evolve has recently received sign...

Please sign up or login with your details

Forgot password? Click here to reset