Self-supervised Consensus Representation Learning for Attributed Graph

08/10/2021
by   Changshu Liu, et al.
0

Attempting to fully exploit the rich information of topological structure and node features for attributed graph, we introduce self-supervised learning mechanism to graph representation learning and propose a novel Self-supervised Consensus Representation Learning (SCRL) framework. In contrast to most existing works that only explore one graph, our proposed SCRL method treats graph from two perspectives: topology graph and feature graph. We argue that their embeddings should share some common information, which could serve as a supervisory signal. Specifically, we construct the feature graph of node features via k-nearest neighbor algorithm. Then graph convolutional network (GCN) encoders extract features from two graphs respectively. Self-supervised loss is designed to maximize the agreement of the embeddings of the same node in the topology graph and the feature graph. Extensive experiments on real citation networks and social networks demonstrate the superiority of our proposed SCRL over the state-of-the-art methods on semi-supervised node classification task. Meanwhile, compared with its main competitors, SCRL is rather efficient.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/02/2022

Structure-Preserving Graph Representation Learning

Though graph representation learning (GRL) has made significant progress...
research
11/15/2018

SGR: Self-Supervised Spectral Graph Representation Learning

Representing a graph as a vector is a challenging task; ideally, the rep...
research
11/01/2022

Revisiting Heterophily in Graph Convolution Networks by Learning Representations Across Topological and Feature Spaces

Graph convolution networks (GCNs) have been enormously successful in lea...
research
12/08/2022

Alleviating neighbor bias: augmenting graph self-supervise learning with structural equivalent positive samples

In recent years, using a self-supervised learning framework to learn the...
research
12/06/2022

Self-supervised Graph Representation Learning for Black Market Account Detection

Nowadays, Multi-purpose Messaging Mobile App (MMMA) has become increasin...
research
05/31/2023

There is more to graphs than meets the eye: Learning universal features with self-supervision

We study the problem of learning universal features across multiple grap...
research
08/22/2022

Self-Supervised Pretraining of Graph Neural Network for the Retrieval of Related Mathematical Expressions in Scientific Articles

Given the increase of publications, search for relevant papers becomes t...

Please sign up or login with your details

Forgot password? Click here to reset