Graph Contrastive Learning with Personalized Augmentation

09/14/2022
by   Xin Zhang, et al.
0

Graph contrastive learning (GCL) has emerged as an effective tool for learning unsupervised representations of graphs. The key idea is to maximize the agreement between two augmented views of each graph via data augmentation. Existing GCL models mainly focus on applying identical augmentation strategies for all graphs within a given scenario. However, real-world graphs are often not monomorphic but abstractions of diverse natures. Even within the same scenario (e.g., macromolecules and online communities), different graphs might need diverse augmentations to perform effective GCL. Thus, blindly augmenting all graphs without considering their individual characteristics may undermine the performance of GCL arts.To deal with this, we propose the first principled framework, termed as Graph contrastive learning with Personalized Augmentation (GPA), to advance conventional GCL by allowing each graph to choose its own suitable augmentation operations.In essence, GPA infers tailored augmentation strategies for each graph based on its topology and node attributes via a learnable augmentation selector, which is a plug-and-play module and can be effectively trained with downstream GCL models end-to-end. Extensive experiments across 11 benchmark graphs from different types and domains demonstrate the superiority of GPA against state-of-the-art competitors.Moreover, by visualizing the learned augmentation distributions across different types of datasets, we show that GPA can effectively identify the most suitable augmentations for each graph based on its characteristics.

READ FULL TEXT
research
02/14/2022

Adversarial Graph Contrastive Learning with Information Regularization

Contrastive learning is an effective unsupervised method in graph repres...
research
10/27/2020

Graph Contrastive Learning with Adaptive Augmentation

Recently, contrastive learning (CL) has emerged as a successful method f...
research
10/05/2022

Revisiting Graph Contrastive Learning from the Perspective of Graph Spectrum

Graph Contrastive Learning (GCL), learning the node representations by a...
research
07/03/2023

ENGAGE: Explanation Guided Data Augmentation for Graph Representation Learning

The recent contrastive learning methods, due to their effectiveness in r...
research
02/06/2023

Spectral Augmentations for Graph Contrastive Learning

Contrastive learning has emerged as a premier method for learning repres...
research
03/17/2022

Graph Augmentation Learning

Graph Augmentation Learning (GAL) provides outstanding solutions for gra...
research
03/24/2023

Hybrid Augmented Automated Graph Contrastive Learning

Graph augmentations are essential for graph contrastive learning. Most e...

Please sign up or login with your details

Forgot password? Click here to reset