Multi-Scale Contrastive Siamese Networks for Self-Supervised Graph Representation Learning

05/12/2021
by   Ming Jin, et al.
0

Graph representation learning plays a vital role in processing graph-structured data. However, prior arts on graph representation learning heavily rely on the labeling information. To overcome this problem, inspired by the recent success of graph contrastive learning and Siamese networks in visual representation learning, we propose a novel self-supervised approach in this paper to learn node representations by enhancing Siamese self-distillation with multi-scale contrastive learning. Specifically, we first generate two augmented views from the input graph based on local and global perspectives. Then, we employ two objectives called cross-view and cross-network contrastiveness to maximize the agreement between node representations across different views and networks. To demonstrate the effectiveness of our approach, we perform empirical experiments on five real-world datasets. Our method not only achieves new state-of-the-art results but also surpasses some semi-supervised counterparts by large margins.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/10/2020

Contrastive Multi-View Representation Learning on Graphs

We introduce a self-supervised approach for learning node and graph leve...
research
11/20/2021

Towards Graph Self-Supervised Learning with Contrastive Adjusted Zooming

Graph representation learning (GRL) is critical for graph-structured dat...
research
12/15/2021

Graph Representation Learning via Contrasting Cluster Assignments

With the rise of contrastive learning, unsupervised graph representation...
research
03/20/2023

Exploring Representation Learning for Small-Footprint Keyword Spotting

In this paper, we investigate representation learning for low-resource k...
research
06/07/2021

Self-Supervised Graph Learning with Proximity-based Views and Channel Contrast

We consider graph representation learning in a self-supervised manner. G...
research
10/21/2022

HCL: Improving Graph Representation with Hierarchical Contrastive Learning

Contrastive learning has emerged as a powerful tool for graph representa...
research
07/06/2021

Multi-Level Graph Contrastive Learning

Graph representation learning has attracted a surge of interest recently...

Please sign up or login with your details

Forgot password? Click here to reset