Self-Attention Graph Pooling

04/17/2019
by   Junhyun Lee, et al.
0

Advanced methods of applying deep learning to structured data such as graphs have been proposed in recent years. In particular, studies have focused on generalizing convolutional neural networks to graph data, which includes redefining the convolution and the downsampling (pooling) operations for graphs. The method of generalizing the convolution operation to graphs has been proven to improve performance and is widely used. However, the method of applying downsampling to graphs is still difficult to perform and has room for improvement. In this paper, we propose a graph pooling method based on self-attention. Self-attention using graph convolution allows our pooling method to consider both node features and graph topology. To ensure a fair comparison, the same training procedures and model architectures were used for the existing pooling methods and our method. The experimental results demonstrate that our method achieves superior graph classification performance on the benchmark datasets using a reasonable number of parameters.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/11/2020

PiNet: Attention Pooling for Graph Classification

We propose PiNet, a generalised differentiable attention-based pooling m...
research
08/22/2022

Mix-Pooling Strategy for Attention Mechanism

Recently many effective self-attention modules are proposed to boot the ...
research
06/03/2020

SimPool: Towards Topology Based Graph Pooling with Structural Similarity Features

Deep learning methods for graphs have seen rapid progress in recent year...
research
12/28/2020

LookHops: light multi-order convolution and pooling for graph classification

Convolution and pooling are the key operations to learn hierarchical rep...
research
03/31/2019

Clique pooling for graph classification

We propose a novel graph pooling operation using cliques as the unit poo...
research
08/02/2022

Maximal Independent Vertex Set applied to Graph Pooling

Convolutional neural networks (CNN) have enabled major advances in image...
research
03/27/2018

Tensor graph convolutional neural network

In this paper, we propose a novel tensor graph convolutional neural netw...

Please sign up or login with your details

Forgot password? Click here to reset