RoSA: A Robust Self-Aligned Framework for Node-Node Graph Contrastive Learning

04/29/2022
by   Yun Zhu, et al.
0

Graph contrastive learning has gained significant progress recently. However, existing works have rarely explored non-aligned node-node contrasting. In this paper, we propose a novel graph contrastive learning method named RoSA that focuses on utilizing non-aligned augmented views for node-level representation learning. First, we leverage the earth mover's distance to model the minimum effort to transform the distribution of one view to the other as our contrastive objective, which does not require alignment between views. Then we introduce adversarial training as an auxiliary method to increase sampling diversity and enhance the robustness of our model. Experimental results show that RoSA outperforms a series of graph contrastive learning frameworks on homophilous, non-homophilous and dynamic graphs, which validates the effectiveness of our work. To the best of our awareness, RoSA is the first work focuses on the non-aligned node-node graph contrastive learning problem. Our codes are available at: \href{https://github.com/ZhuYun97/RoSA}{\texttt{https://github.com/ZhuYun97/RoSA}}

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 7

page 9

page 10

research
12/14/2022

MA-GCL: Model Augmentation Tricks for Graph Contrastive Learning

Contrastive learning (CL), which can extract the information shared betw...
research
06/10/2020

Contrastive Multi-View Representation Learning on Graphs

We introduce a self-supervised approach for learning node and graph leve...
research
06/24/2023

Similarity Preserving Adversarial Graph Contrastive Learning

Recent works demonstrate that GNN models are vulnerable to adversarial a...
research
05/27/2022

Bayesian Robust Graph Contrastive Learning

Graph Neural Networks (GNNs) have been widely used to learn node represe...
research
10/07/2022

Augmentations in Hypergraph Contrastive Learning: Fabricated and Generative

This paper targets at improving the generalizability of hypergraph neura...
research
06/09/2022

I'm Me, We're Us, and I'm Us: Tri-directional Contrastive Learning on Hypergraphs

Although machine learning on hypergraphs has attracted considerable atte...
research
01/24/2022

Learning Graph Augmentations to Learn Graph Representations

Devising augmentations for graph contrastive learning is challenging due...

Please sign up or login with your details

Forgot password? Click here to reset