Augmentation-Free Self-Supervised Learning on Graphs

12/05/2021
by   Namkyeong Lee, et al.
0

Inspired by the recent success of self-supervised methods applied on images, self-supervised learning on graph structured data has seen rapid growth especially centered on augmentation-based contrastive methods. However, we argue that without carefully designed augmentation techniques, augmentations on graphs may behave arbitrarily in that the underlying semantics of graphs can drastically change. As a consequence, the performance of existing augmentation-based methods is highly dependent on the choice of augmentation scheme, i.e., hyperparameters associated with augmentations. In this paper, we propose a novel augmentation-free self-supervised learning framework for graphs, named AFGRL. Specifically, we generate an alternative view of a graph by discovering nodes that share the local structural information and the global semantics with the graph. Extensive experiments towards various node-level tasks, i.e., node classification, clustering, and similarity search on various real-world datasets demonstrate the superiority of AFGRL. The source code for AFGRL is available at https://github.com/Namkyeong/AFGRL.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/21/2022

Relational Self-Supervised Learning on Graphs

Over the past few years, graph representation learning (GRL) has been a ...
research
06/10/2022

Masked Autoencoders are Robust Data Augmentors

Deep neural networks are capable of learning powerful representations to...
research
04/11/2022

Augmentation-Free Graph Contrastive Learning

Graph contrastive learning (GCL) is the most representative and prevalen...
research
06/16/2023

HomoGCL: Rethinking Homophily in Graph Contrastive Learning

Contrastive learning (CL) has become the de-facto learning paradigm in s...
research
10/02/2022

Spectral Augmentation for Self-Supervised Learning on Graphs

Graph contrastive learning (GCL), as an emerging self-supervised learnin...
research
06/10/2021

Automated Self-Supervised Learning for Graphs

Graph self-supervised learning has gained increasing attention due to it...
research
01/11/2022

Bootstrapping Informative Graph Augmentation via A Meta Learning Approach

Recent works explore learning graph representations in a self-supervised...

Please sign up or login with your details

Forgot password? Click here to reset