Multi-modality Meets Re-learning: Mitigating Negative Transfer in Sequential Recommendation

09/18/2023
by   Bo Peng, et al.
1

Learning effective recommendation models from sparse user interactions represents a fundamental challenge in developing sequential recommendation methods. Recently, pre-training-based methods have been developed to tackle this challenge. Though promising, in this paper, we show that existing methods suffer from the notorious negative transfer issue, where the model adapted from the pre-trained model results in worse performance compared to the model learned from scratch in the task of interest (i.e., target task). To address this issue, we develop a method, denoted as ANT, for transferable sequential recommendation. ANT mitigates negative transfer by 1) incorporating multi-modality item information, including item texts, images and prices, to effectively learn more transferable knowledge from related tasks (i.e., auxiliary tasks); and 2) better capturing task-specific knowledge in the target task using a re-learning-based adaptation strategy. We evaluate ANT against eight state-of-the-art baseline methods on five target tasks. Our experimental results demonstrate that ANT does not suffer from the negative transfer issue on any of the target tasks. The results also demonstrate that ANT substantially outperforms baseline methods in the target tasks with an improvement of as much as 15.2 re-learning-based strategy compared to fine-tuning on the target tasks.

READ FULL TEXT
research
09/16/2022

Recursive Attentive Methods with Reused Item Representations for Sequential Recommendation

Sequential recommendation aims to recommend the next item of users' inte...
research
05/06/2023

Attacking Pre-trained Recommendation

Recently, a series of pioneer studies have shown the potency of pre-trai...
research
02/03/2023

Gradient Estimation for Unseen Domain Risk Minimization with Pre-Trained Models

Domain generalization aims to build generalized models that perform well...
research
05/17/2019

Story Ending Prediction by Transferable BERT

Recent advances, such as GPT and BERT, have shown success in incorporati...
research
07/07/2023

AdaptiveRec: Adaptively Construct Pairs for Contrastive Learning in Sequential Recommendation

This paper presents a solution to the challenges faced by contrastive le...
research
04/26/2023

Self-Supervised Multi-Modal Sequential Recommendation

With the increasing development of e-commerce and online services, perso...
research
08/16/2023

STEM: Unleashing the Power of Embeddings for Multi-task Recommendation

Multi-task learning (MTL) has gained significant popularity in recommend...

Please sign up or login with your details

Forgot password? Click here to reset