Towards Neural Mixture Recommender for Long Range Dependent User Sequences

02/22/2019
by   Jiaxi Tang, et al.
20

Understanding temporal dynamics has proved to be highly valuable for accurate recommendation. Sequential recommenders have been successful in modeling the dynamics of users and items over time. However, while different model architectures excel at capturing various temporal ranges or dynamics, distinct application contexts require adapting to diverse behaviors. In this paper we examine how to build a model that can make use of different temporal ranges and dynamics depending on the request context. We begin with the analysis of an anonymized Youtube dataset comprising millions of user sequences. We quantify the degree of long-range dependence in these sequences and demonstrate that both short-term and long-term dependent behavioral patterns co-exist. We then propose a neural Multi-temporal-range Mixture Model (M3) as a tailored solution to deal with both short-term and long-term dependencies. Our approach employs a mixture of models, each with a different temporal range. These models are combined by a learned gating mechanism capable of exerting different model combinations given different contextual information. In empirical evaluations on a public dataset and our own anonymized YouTube dataset, M3 consistently outperforms state-of-the-art sequential recommendation methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/11/2021

Leaping Through Time with Gradient-based Adaptation for Recommendation

Modern recommender systems are required to adapt to the change in user p...
research
05/23/2019

Quantifying Long Range Dependence in Language and User Behavior to improve RNNs

Characterizing temporal dependence patterns is a critical step in unders...
research
08/12/2020

Sequential recommendation with metric models based on frequent sequences

Modeling user preferences (long-term history) and user dynamics (short-t...
research
08/20/2018

Dynamic Intention-Aware Recommendation with Self-Attention

Predicting the missing values given the observed interaction matrix is a...
research
05/18/2020

Hybrid Sequential Recommender via Time-aware Attentive Memory Network

Recommendation systems aim to assist users to discover most preferred co...
research
08/17/2021

MOI-Mixer: Improving MLP-Mixer with Multi Order Interactions in Sequential Recommendation

Successful sequential recommendation systems rely on accurately capturin...
research
09/27/2020

Handwriting Prediction Considering Inter-Class Bifurcation Structures

Temporal prediction is a still difficult task due to the chaotic behavio...

Please sign up or login with your details

Forgot password? Click here to reset