Attention Models in Graphs: A Survey

07/20/2018
by   John Boaz Lee, et al.
0

Graph-structured data arise naturally in many different application domains. By representing data as graphs, we can capture entities (i.e., nodes) as well as their relationships (i.e., edges) with each other. Many useful insights can be derived from graph-structured data as demonstrated by an ever-growing body of work focused on graph mining. However, in the real-world, graphs can be both large - with many complex patterns - and noisy which can pose a problem for effective graph mining. An effective way to deal with this issue is to incorporate "attention" into graph mining solutions. An attention mechanism allows a method to focus on task-relevant parts of the graph, helping it to make better decisions. In this work, we conduct a comprehensive and focused survey of the literature on the emerging field of graph attention models. We introduce three intuitive taxonomies to group existing work. These are based on problem setting (type of input and output), the type of attention mechanism used, and the task (e.g., graph classification, link prediction, etc.). We motivate our taxonomies through detailed examples and use each to survey competing approaches from a unique standpoint. Finally, we highlight several challenges in the area and discuss promising directions for future work.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/22/2017

A Comprehensive Survey of Graph Embedding: Problems, Techniques and Applications

Graph is an important data representation which appears in a wide divers...
research
09/15/2017

Deep Graph Attention Model

Graph classification is a problem with practical applications in many di...
research
12/17/2022

Graph Learning: A Comprehensive Survey and Future Directions

Graph learning aims to learn complex relationships among nodes and the t...
research
05/11/2022

A Survey on Fairness for Machine Learning on Graphs

Nowadays, the analysis of complex phenomena modeled by graphs plays a cr...
research
03/13/2022

A Survey on Deep Graph Generation: Methods and Applications

Graphs are ubiquitous in encoding relational information of real-world o...
research
01/31/2022

Interpretable and Generalizable Graph Learning via Stochastic Attention Mechanism

Interpretable graph learning is in need as many scientific applications ...
research
03/30/2012

Transforming Graph Representations for Statistical Relational Learning

Relational data representations have become an increasingly important to...

Please sign up or login with your details

Forgot password? Click here to reset