XSimGCL: Towards Extremely Simple Graph Contrastive Learning for Recommendation

09/06/2022
by   Junliang Yu, et al.
0

Contrastive learning (CL) has recently been demonstrated critical in improving recommendation performance. The fundamental idea of CL-based recommendation models is to maximize the consistency between representations learned from different graph augmentations of the user-item bipartite graph. In such a self-supervised manner, CL-based recommendation models are expected to extract general features from the raw data to tackle the data sparsity issue. Despite the effectiveness of this paradigm, we still have no clue what underlies the performance gains. In this paper, we first reveal that CL enhances recommendation through endowing the model with the ability to learn more evenly distributed user/item representations, which can implicitly alleviate the pervasive popularity bias and promote long-tail items. Meanwhile, we find that the graph augmentations, which were considered a necessity in prior studies, are relatively unreliable and less significant in CL-based recommendation. On top of these findings, we put forward an eXtremely Simple Graph Contrastive Learning method (XSimGCL) for recommendation, which discards the ineffective graph augmentations and instead employs a simple yet effective noise-based embedding augmentation to create views for CL. A comprehensive experimental study on three large and highly sparse benchmark datasets demonstrates that, though the proposed method is extremely simple, it can smoothly adjust the uniformity of learned representations and outperforms its graph augmentation-based counterparts by a large margin in both recommendation accuracy and training efficiency. The code is released at https://github.com/Coder-Yu/SELFRec.

READ FULL TEXT

page 4

page 13

research
12/16/2021

Graph Augmentation-Free Contrastive Learning for Recommendation

Contrastive learning (CL) recently has received considerable attention i...
research
02/16/2023

LightGCL: Simple Yet Effective Graph Contrastive Learning for Recommendation

Graph neural network (GNN) is a powerful learning approach for graph-bas...
research
05/08/2023

Graph Masked Autoencoder for Sequential Recommendation

While some powerful neural network architectures (e.g., Transformer, Gra...
research
05/18/2023

Adaptive Graph Contrastive Learning for Recommendation

Recently, graph neural networks (GNNs) have been successfully applied to...
research
06/01/2022

CrossCBR: Cross-view Contrastive Learning for Bundle Recommendation

Bundle recommendation aims to recommend a bundle of related items to use...
research
05/20/2020

Contrastive Learning for Debiased Candidate Generation at Scale

Deep candidate generation has become an increasingly popular choice depl...
research
08/24/2021

Self-Supervised Graph Co-Training for Session-based Recommendation

Session-based recommendation targets next-item prediction by exploiting ...

Please sign up or login with your details

Forgot password? Click here to reset