Unsupervised Universal Self-Attention Network for Graph Classification

09/26/2019
by   Dai Quoc Nguyen, et al.
0

Existing graph embedding models often have weaknesses in exploiting graph structure similarities, potential dependencies among nodes and global network properties. To this end, we present U2GAN, a novel unsupervised model leveraging on the strength of the recently introduced universal self-attention network (Dehghani et al., 2019), to learn low-dimensional embeddings of graphs which can be used for graph classification. In particular, given an input graph, U2GAN first applies a self-attention computation, which is then followed by a recurrent transition to iteratively memorize its attention on vector representations of each node and its neighbors across each iteration. Thus, U2GAN can address the weaknesses in the existing models in order to produce plausible node embeddings whose sum is the final embedding of the whole graph. Experimental results show that our unsupervised U2GAN produces new state-of-the-art performances on a range of well-known benchmark datasets for the graph classification task. It even outperforms supervised methods in most of benchmark cases.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/22/2020

A Self-Attention Network based Node Embedding Model

Despite several signs of progress have been made recently, limited resea...
research
11/12/2019

A Capsule Network-based Model for Learning Node Embeddings

In this paper, we focus on learning low-dimensional embeddings of entity...
research
04/04/2019

DAGCN: Dual Attention Graph Convolutional Networks

Graph convolutional networks (GCNs) have recently become one of the most...
research
05/20/2018

Learning Graph-Level Representations with Gated Recurrent Neural Networks

Recently a variety of methods have been developed to encode graphs into ...
research
05/31/2023

There is more to graphs than meets the eye: Learning universal features with self-supervision

We study the problem of learning universal features across multiple grap...
research
07/13/2019

Relational Memory-based Knowledge Graph Embedding

Knowledge graph embedding models often suffer from a limitation of remem...
research
01/27/2023

On the Connection Between MPNN and Graph Transformer

Graph Transformer (GT) recently has emerged as a new paradigm of graph l...

Please sign up or login with your details

Forgot password? Click here to reset