Déjà vu: A Contextualized Temporal Attention Mechanism for Sequential Recommendation

01/29/2020
by   Jibang Wu, et al.
0

Predicting users' preferences based on their sequential behaviors in history is challenging and crucial for modern recommender systems. Most existing sequential recommendation algorithms focus on transitional structure among the sequential actions, but largely ignore the temporal and context information, when modeling the influence of a historical event to current prediction. In this paper, we argue that the influence from the past events on a user's current action should vary over the course of time and under different context. Thus, we propose a Contextualized Temporal Attention Mechanism that learns to weigh historical actions' influence on not only what action it is, but also when and how the action took place. More specifically, to dynamically calibrate the relative input dependence from the self-attention mechanism, we deploy multiple parameterized kernel functions to learn various temporal dynamics, and then use the context information to determine which of these reweighing kernels to follow for each input. In empirical evaluations on two large public recommendation datasets, our model consistently outperformed an extensive set of state-of-the-art sequential recommendation methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/17/2023

Attention Mixtures for Time-Aware Sequential Recommendation

Transformers emerged as powerful methods for sequential recommendation. ...
research
08/29/2022

Time-aware Self-Attention Meets Logic Reasoning in Recommender Systems

At the age of big data, recommender systems have shown remarkable succes...
research
08/20/2018

Self-Attentive Sequential Recommendation

Sequential dynamics are a key feature of many modern recommender systems...
research
04/30/2022

Designing a Sequential Recommendation System for Heterogeneous Interactions Using Transformers

While many production-ready and robust algorithms are available for the ...
research
06/13/2022

Recommender Transformers with Behavior Pathways

Sequential recommendation requires the recommender to capture the evolvi...
research
10/24/2022

Towards Out-of-Distribution Sequential Event Prediction: A Causal Treatment

The goal of sequential event prediction is to estimate the next event ba...
research
07/04/2018

Recommendation Systems and Self Motivated Users

Modern recommendation systems rely on the wisdom of the crowd to learn t...

Please sign up or login with your details

Forgot password? Click here to reset