Relational Graph Attention Networks

04/11/2019
by   Dan Busbridge, et al.
12

We investigate Relational Graph Attention Networks, a class of models that extends non-relational graph attention mechanisms to incorporate relational information, opening up these methods to a wider variety of problems. A thorough evaluation of these models is performed, and comparisons are made against established benchmarks. To provide a meaningful comparison, we retrain Relational Graph Convolutional Networks, the spectral counterpart of Relational Graph Attention Networks, and evaluate them under the same conditions. We find that Relational Graph Attention Networks perform worse than anticipated, although some configurations are marginally beneficial for modelling molecular properties. We provide insights as to why this may be, and suggest both modifications to evaluation strategies, as well as directions to investigate for future work.

READ FULL TEXT

page 3

page 16

page 19

page 20

page 21

research
02/13/2021

Bridging Graph Neural Networks and Statistical Relational Learning: Relational One-Class GCN

We consider the problem of learning Graph Convolutional Networks (GCNs) ...
research
07/21/2021

Relational Graph Convolutional Networks: A Closer Look

In this paper, we describe a reproduction of the Relational Graph Convol...
research
11/01/2018

SARN: Relational Reasoning through Sequential Attention

This paper proposes an attention module augmented relational network cal...
research
10/12/2022

Relational Graph Convolutional Neural Networks for Multihop Reasoning: A Comparative Study

Multihop Question Answering is a complex Natural Language Processing tas...
research
03/17/2017

Modeling Relational Data with Graph Convolutional Networks

Knowledge graphs enable a wide variety of applications, including questi...
research
05/25/2023

Optimization and Interpretability of Graph Attention Networks for Small Sparse Graph Structures in Automotive Applications

For automotive applications, the Graph Attention Network (GAT) is a prom...
research
01/16/2023

Clustered Relational Thread-Modular Abstract Interpretation with Local Traces

We construct novel thread-modular analyses that track relational informa...

Please sign up or login with your details

Forgot password? Click here to reset