Self-supervised Graph Learning for Recommendation

10/21/2020
by   Jiancan Wu, et al.
0

Representation learning on user-item graph for recommendation has evolved from using single ID or interaction history to exploiting higher-order neighbors. This leads to the success of graph convolution networks (GCNs) for recommendation such as PinSage and LightGCN. Despite effectiveness, we argue that they suffer from two limitations: (1) high-degree nodes exert larger impact on the representation learning, deteriorating the recommendations of low-degree (long-tail) items; and (2) representations are vulnerable to noisy interactions, as the neighborhood aggregation scheme further enlarges the impact of observed edges. In this work, we explore self-supervised learning on user-item graph, so as to improve the accuracy and robustness of GCNs for recommendation. The idea is to supplement the classical supervised task of recommendation with an auxiliary self-supervised task, which reinforces node representation learning via self-discrimination. Specifically, we generate multiple views of a node, maximizing the agreement between different views of the same node compared to that of other nodes. We devise four operators to generate the views – embedding masking, embedding dropout, node dropout, and edge dropout – that augment node representation from two perspectives of ID embedding and graph structure. We term this new learning paradigm as Self-supervised Graph Learning (SGL), implementing it on the state-of-the-art model LightGCN. Empirical studies on three benchmark datasets demonstrate the effectiveness of SGL, which improves the recommendation accuracy, especially on long-tail items, and the robustness against interaction noises.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/07/2021

Socially-Aware Self-Supervised Tri-Training for Recommendation

Self-supervised learning (SSL), which can automatically generate ground-...
research
04/26/2022

A Review-aware Graph Contrastive Learning Framework for Recommendation

Most modern recommender systems predict users preferences with two compo...
research
01/07/2022

On the Effectiveness of Sampled Softmax Loss for Item Recommendation

Learning objectives of recommender models remain largely unexplored. Mos...
research
08/24/2021

Self-Supervised Graph Co-Training for Session-based Recommendation

Session-based recommendation targets next-item prediction by exploiting ...
research
10/15/2022

Self-supervised Graph Learning for Long-tailed Cognitive Diagnosis

Cognitive diagnosis is a fundamental yet critical research task in the f...
research
02/18/2020

Neural Attentive Multiview Machines

An important problem in multiview representation learning is finding the...
research
06/07/2021

Self-Supervised Graph Learning with Proximity-based Views and Channel Contrast

We consider graph representation learning in a self-supervised manner. G...

Please sign up or login with your details

Forgot password? Click here to reset