Contrastive Self-supervised Sequential Recommendation with Robust Augmentation

08/14/2021
by   Zhiwei Liu, et al.
5

Sequential Recommendationdescribes a set of techniques to model dynamic user behavior in order to predict future interactions in sequential user data. At their core, such approaches model transition probabilities between items in a sequence, whether through Markov chains, recurrent networks, or more recently, Transformers. However both old and new issues remain, including data-sparsity and noisy data; such issues can impair the performance, especially in complex, parameter-hungry models. In this paper, we investigate the application of contrastive Self-Supervised Learning (SSL) to the sequential recommendation, as a way to alleviate some of these issues. Contrastive SSL constructs augmentations from unlabelled instances, where agreements among positive pairs are maximized. It is challenging to devise a contrastive SSL framework for a sequential recommendation, due to its discrete nature, correlations among items, and skewness of length distributions. To this end, we propose a novel framework, Contrastive Self-supervised Learning for sequential Recommendation (CoSeRec). We introduce two informative augmentation operators leveraging item correlations to create high-quality views for contrastive learning. Experimental results on three real-world datasets demonstrate the effectiveness of the proposed method on improving model performance and the robustness against sparse and noisy data. Our implementation is available online at <https://github.com/YChen1993/CoSeRec>

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/25/2022

Improving Contrastive Learning with Model Augmentation

The sequential recommendation aims at predicting the next items in user ...
research
08/20/2023

Enhancing Transformers without Self-supervised Learning: A Loss Landscape Perspective in Sequential Recommendation

Transformer and its variants are a powerful class of architectures for s...
research
01/28/2023

Mutual Wasserstein Discrepancy Minimization for Sequential Recommendation

Self-supervised sequential recommendation significantly improves recomme...
research
08/07/2023

Hierarchical Contrastive Learning with Multiple Augmentation for Sequential Recommendation

Sequential recommendation addresses the issue of preference drift by pre...
research
12/16/2021

Graph Augmentation-Free Contrastive Learning for Recommendation

Contrastive learning (CL) recently has received considerable attention i...
research
07/07/2023

AdaptiveRec: Adaptively Construct Pairs for Contrastive Learning in Sequential Recommendation

This paper presents a solution to the challenges faced by contrastive le...
research
02/05/2022

Intent Contrastive Learning for Sequential Recommendation

Users' interactions with items are driven by various intents (e.g., prep...

Please sign up or login with your details

Forgot password? Click here to reset