Contrastive Learning for Recommender System

01/05/2021
by   Zhuang Liu, et al.
0

Recommender systems, which analyze users' preference patterns to suggest potential targets, are indispensable in today's society. Collaborative Filtering (CF) is the most popular recommendation model. Specifically, Graph Neural Network (GNN) has become a new state-of-the-art for CF. In the GNN-based recommender system, message dropout is usually used to alleviate the selection bias in the user-item bipartite graph. However, message dropout might deteriorate the recommender system's performance due to the randomness of dropping out the outgoing messages based on the user-item bipartite graph. To solve this problem, we propose a graph contrastive learning module for a general recommender system that learns the embeddings in a self-supervised manner and reduces the randomness of message dropout. Besides, many recommender systems optimize models with pairwise ranking objectives, such as the Bayesian Pairwise Ranking (BPR) based on a negative sampling strategy. However, BPR has the following problems: suboptimal sampling and sample bias. We introduce a new debiased contrastive loss to solve these problems, which provides sufficient negative samples and applies a bias correction probability to alleviate the sample bias. We integrate the proposed framework, including graph contrastive module and debiased contrastive module with several Matrix Factorization(MF) and GNN-based recommendation models. Experimental results on three public benchmarks demonstrate the effectiveness of our framework.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/28/2022

Self-Supervised Hypergraph Transformer for Recommender Systems

Graph Neural Networks (GNNs) have been shown as promising solutions for ...
research
05/18/2023

Adaptive Graph Contrastive Learning for Recommendation

Recently, graph neural networks (GNNs) have been successfully applied to...
research
05/20/2020

Contrastive Learning for Debiased Candidate Generation at Scale

Deep candidate generation has become an increasingly popular choice depl...
research
05/20/2020

Contrastive Learning for Debiased Candidate Generation in Large-Scale Recommender Systems

Deep candidate generation (DCG) that narrows down the collection of rele...
research
08/18/2022

Debiasing Neighbor Aggregation for Graph Neural Network in Recommender Systems

Graph neural networks (GNNs) have achieved remarkable success in recomme...
research
11/25/2022

Soft BPR Loss for Dynamic Hard Negative Sampling in Recommender Systems

In recommender systems, leveraging Graph Neural Networks (GNNs) to formu...
research
01/07/2022

On the Effectiveness of Sampled Softmax Loss for Item Recommendation

Learning objectives of recommender models remain largely unexplored. Mos...

Please sign up or login with your details

Forgot password? Click here to reset