Hierarchical Contrastive Learning with Multiple Augmentation for Sequential Recommendation

08/07/2023
by   Dongjun Lee, et al.
0

Sequential recommendation addresses the issue of preference drift by predicting the next item based on the user's previous behaviors. Recently, a promising approach using contrastive learning has emerged, demonstrating its effectiveness in recommending items under sparse user-item interactions. Significantly, the effectiveness of combinations of various augmentation methods has been demonstrated in different domains, particularly in computer vision. However, when it comes to augmentation within a contrastive learning framework in sequential recommendation, previous research has only focused on limited conditions and simple structures. Thus, it is still possible to extend existing approaches to boost the effects of augmentation methods by using progressed structures with the combinations of multiple augmentation methods. In this work, we propose a novel framework called Hierarchical Contrastive Learning with Multiple Augmentation for Sequential Recommendation(HCLRec) to overcome the aforementioned limitation. Our framework leverages existing augmentation methods hierarchically to improve performance. By combining augmentation methods continuously, we generate low-level and high-level view pairs. We employ a Transformers-based model to encode the input sequence effectively. Furthermore, we introduce additional blocks consisting of Transformers and position-wise feed-forward network(PFFN) layers to learn the invariance of the original sequences from hierarchically augmented views. We pass the input sequence to subsequent layers based on the number of increment levels applied to the views to handle various augmentation levels. Within each layer, we compute contrastive loss between pairs of views at the same level. Extensive experiments demonstrate that our proposed method outperforms state-of-the-art approaches and that HCLRec is robust even when faced with the problem of sparse interaction.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/25/2022

Improving Contrastive Learning with Model Augmentation

The sequential recommendation aims at predicting the next items in user ...
research
08/14/2021

Contrastive Self-supervised Sequential Recommendation with Robust Augmentation

Sequential Recommendationdescribes a set of techniques to model dynamic ...
research
08/27/2022

Multi-level Contrastive Learning Framework for Sequential Recommendation

Sequential recommendation (SR) aims to predict the subsequent behaviors ...
research
08/08/2022

Contrastive Learning with Bidirectional Transformers for Sequential Recommendation

Contrastive learning with Transformer-based sequence encoder has gained ...
research
07/07/2023

AdaptiveRec: Adaptively Construct Pairs for Contrastive Learning in Sequential Recommendation

This paper presents a solution to the challenges faced by contrastive le...
research
12/13/2021

Sequential Recommendation with Bidirectional Chronological Augmentation of Transformer

Sequential recommendation can capture user chronological preferences fro...
research
04/16/2023

Meta-optimized Contrastive Learning for Sequential Recommendation

Contrastive Learning (CL) performances as a rising approach to address t...

Please sign up or login with your details

Forgot password? Click here to reset