Equivariant Contrastive Learning for Sequential Recommendation

11/10/2022
by   Peilin Zhou, et al.
0

Contrastive learning (CL) benefits the training of sequential recommendation models with informative self-supervision signals. Existing solutions apply general sequential data augmentation strategies to generate positive pairs and encourage their representations to be invariant. However, due to the inherent properties of user behavior sequences, some augmentation strategies, such as item substitution, can lead to changes in user intent. Learning indiscriminately invariant representations for all augmentation strategies might be sub-optimal. Therefore, we propose Equivariant Contrastive Learning for Sequential Recommendation (ECL-SR), which endows SR models with great discriminative power, making the learned user behavior representations sensitive to invasive augmentations (e.g., item substitution) and insensitive to mild augmentations (e.g., feature-level dropout masking). In detail, we use the conditional discriminator to capture differences in behavior due to item substitution, which encourages the user behavior encoder to be equivariant to invasive augmentations. Comprehensive experiments on four benchmark datasets show that the proposed ECL-SR framework achieves competitive performance compared to state-of-the-art SR models. The source code will be released.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/27/2022

Multi-level Contrastive Learning Framework for Sequential Recommendation

Sequential recommendation (SR) aims to predict the subsequent behaviors ...
research
10/12/2021

Contrastive Learning for Representation Degeneration Problem in Sequential Recommendation

Recent advancements of sequential deep learning models such as Transform...
research
02/05/2022

Intent Contrastive Learning for Sequential Recommendation

Users' interactions with items are driven by various intents (e.g., prep...
research
12/13/2021

C^2-Rec: An Effective Consistency Constraint for Sequential Recommendation

Sequential recommendation methods play an important role in real-world r...
research
04/05/2022

ELECRec: Training Sequential Recommenders as Discriminators

Sequential recommendation is often considered as a generative task, i.e....
research
12/14/2020

StackRec: Efficient Training of Very Deep Sequential Recommender Models by Layer Stacking

Deep learning has brought great progress for the sequential recommendati...
research
07/20/2023

Language-Enhanced Session-Based Recommendation with Decoupled Contrastive Learning

Session-based recommendation techniques aim to capture dynamic user beha...

Please sign up or login with your details

Forgot password? Click here to reset