ARIEL: Adversarial Graph Contrastive Learning

08/15/2022
by   Shengyu Feng, et al.
0

Contrastive learning is an effective unsupervised method in graph representation learning, and the key component of contrastive learning lies in the construction of positive and negative samples. Previous methods usually utilize the proximity of nodes in the graph as the principle. Recently, the data augmentation based contrastive learning method has advanced to show great power in the visual domain, and some works extended this method from images to graphs. However, unlike the data augmentation on images, the data augmentation on graphs is far less intuitive and much harder to provide high-quality contrastive samples, which leaves much space for improvement. In this work, by introducing an adversarial graph view for data augmentation, we propose a simple but effective method, Adversarial Graph Contrastive Learning (ARIEL), to extract informative contrastive samples within reasonable constraints. We develop a new technique called information regularization for stable training and use subgraph sampling for scalability. We generalize our method from node-level contrastive learning to the graph-level by treating each graph instance as a supernode. ARIEL consistently outperforms the current graph contrastive learning methods for both node-level and graph-level classification tasks on real-world datasets. We further demonstrate that ARIEL is more robust in face of adversarial attacks.

READ FULL TEXT
research
02/14/2022

Adversarial Graph Contrastive Learning with Information Regularization

Contrastive learning is an effective unsupervised method in graph repres...
research
05/02/2022

FastGCL: Fast Self-Supervised Learning on Graphs via Contrastive Neighborhood Aggregation

Graph contrastive learning (GCL), as a popular approach to graph self-su...
research
07/27/2023

Self-Contrastive Graph Diffusion Network

Augmentation techniques and sampling strategies are crucial in contrasti...
research
06/15/2021

Evaluating Modules in Graph Contrastive Learning

The recent emergence of contrastive learning approaches facilitates the ...
research
07/03/2023

ENGAGE: Explanation Guided Data Augmentation for Graph Representation Learning

The recent contrastive learning methods, due to their effectiveness in r...
research
05/19/2022

Label-invariant Augmentation for Semi-Supervised Graph Classification

Recently, contrastiveness-based augmentation surges a new climax in the ...

Please sign up or login with your details

Forgot password? Click here to reset