Adversarial Cross-View Disentangled Graph Contrastive Learning

09/16/2022
by   Qianlong Wen, et al.
0

Graph contrastive learning (GCL) is prevalent to tackle the supervision shortage issue in graph learning tasks. Many recent GCL methods have been proposed with various manually designed augmentation techniques, aiming to implement challenging augmentations on the original graph to yield robust representation. Although many of them achieve remarkable performances, existing GCL methods still struggle to improve model robustness without risking losing task-relevant information because they ignore the fact the augmentation-induced latent factors could be highly entangled with the original graph, thus it is more difficult to discriminate the task-relevant information from irrelevant information. Consequently, the learned representation is either brittle or unilluminating. In light of this, we introduce the Adversarial Cross-View Disentangled Graph Contrastive Learning (ACDGCL), which follows the information bottleneck principle to learn minimal yet sufficient representations from graph data. To be specific, our proposed model elicits the augmentation-invariant and augmentation-dependent factors separately. Except for the conventional contrastive loss which guarantees the consistency and sufficiency of the representations across different contrastive views, we introduce a cross-view reconstruction mechanism to pursue the representation disentanglement. Besides, an adversarial view is added as the third view of contrastive loss to enhance model robustness. We empirically demonstrate that our proposed model outperforms the state-of-the-arts on graph classification task over multiple benchmark datasets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/28/2021

InfoGCL: Information-Aware Graph Contrastive Learning

Various graph contrastive learning models have been proposed to improve ...
research
05/04/2023

Disentangled Contrastive Collaborative Filtering

Recent studies show that graph neural networks (GNNs) are prevalent to m...
research
03/15/2022

Unpaired Deep Image Dehazing Using Contrastive Disentanglement Learning

We present an effective unpaired learning based image dehazing network f...
research
03/09/2023

Distortion-Disentangled Contrastive Learning

Self-supervised learning is well known for its remarkable performance in...
research
04/30/2023

Enhancing Adversarial Contrastive Learning via Adversarial Invariant Regularization

Adversarial contrastive learning (ACL), without requiring labels, incorp...
research
06/05/2020

Robust Face Verification via Disentangled Representations

We introduce a robust algorithm for face verification, i.e., deciding wh...
research
06/20/2023

Contrastive Disentangled Learning on Graph for Node Classification

Contrastive learning methods have attracted considerable attention due t...

Please sign up or login with your details

Forgot password? Click here to reset