Rethinking Multi-Interest Learning for Candidate Matching in Recommender Systems

02/28/2023
by   Yueqi Xie, et al.
0

Existing research efforts for multi-interest candidate matching in recommender systems mainly focus on improving model architecture or incorporating additional information, neglecting the importance of training schemes. This work revisits the training framework and uncovers two major problems hindering the expressiveness of learned multi-interest representations. First, the current training objective (i.e., uniformly sampled softmax) fails to effectively train discriminative representations in a multi-interest learning scenario due to the severe increase in easy negative samples. Second, a routing collapse problem is observed where each learned interest may collapse to express information only from a single item, resulting in information loss. To address these issues, we propose the REMI framework, consisting of an Interest-aware Hard Negative mining strategy (IHN) and a Routing Regularization (RR) method. IHN emphasizes interest-aware hard negatives by proposing an ideal sampling distribution and developing a Monte-Carlo strategy for efficient approximation. RR prevents routing collapse by introducing a novel regularization term on the item-to-interest routing matrices. These two components enhance the learned multi-interest representations from both the optimization objective and the composition information. REMI is a general framework that can be readily applied to various existing multi-interest candidate matching methods. Experiments on three real-world datasets show our method can significantly improve state-of-the-art methods with easy implementation and negligible computational overhead. The source code will be released.

READ FULL TEXT

page 1

page 2

page 8

research
04/24/2023

Joint Semantic and Structural Representation Learning for Enhancing User Preference Modelling

Knowledge graphs (KGs) have become important auxiliary information for h...
research
10/12/2020

Neural Representations in Hybrid Recommender Systems: Prediction versus Regularization

Autoencoder-based hybrid recommender systems have become popular recentl...
research
11/25/2022

Soft BPR Loss for Dynamic Hard Negative Sampling in Recommender Systems

In recommender systems, leveraging Graph Neural Networks (GNNs) to formu...
research
07/08/2021

Unsupervised Proxy Selection for Session-based Recommender Systems

Session-based Recommender Systems (SRSs) have been actively developed to...
research
12/25/2017

Deep Collaborative Autoencoder for Recommender Systems: A Unified Framework for Explicit and Implicit Feedback

In recent years, deep neural networks have yielded state-of-the-art perf...
research
05/10/2022

Bayesian Prior Learning via Neural Networks for Next-item Recommendation

Next-item prediction is a a popular problem in the recommender systems d...
research
08/19/2020

Leveraging Historical Interaction Data for Improving Conversational Recommender System

Recently, conversational recommender system (CRS) has become an emerging...

Please sign up or login with your details

Forgot password? Click here to reset