Dynamic Memory based Attention Network for Sequential Recommendation

02/18/2021
by   Qiaoyu Tan, et al.
0

Sequential recommendation has become increasingly essential in various online services. It aims to model the dynamic preferences of users from their historical interactions and predict their next items. The accumulated user behavior records on real systems could be very long. This rich data brings opportunities to track actual interests of users. Prior efforts mainly focus on making recommendations based on relatively recent behaviors. However, the overall sequential data may not be effectively utilized, as early interactions might affect users' current choices. Also, it has become intolerable to scan the entire behavior sequence when performing inference for each user, since real-world system requires short response time. To bridge the gap, we propose a novel long sequential recommendation model, called Dynamic Memory-based Attention Network (DMAN). It segments the overall long behavior sequence into a series of sub-sequences, then trains the model and maintains a set of memory blocks to preserve long-term interests of users. To improve memory fidelity, DMAN dynamically abstracts each user's long-term interest into its own memory blocks by minimizing an auxiliary reconstruction loss. Based on the dynamic memory, the user's short-term and long-term interests can be explicitly extracted and combined for efficient joint recommendation. Empirical results over four benchmark datasets demonstrate the superiority of our model in capturing long-term dependency over various state-of-the-art sequential models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/06/2020

KATRec: Knowledge Aware aTtentive Sequential Recommendations

Sequential recommendation systems model dynamic preferences of users bas...
research
05/28/2021

Rethinking Lifelong Sequential Recommendation with Incremental Multi-Interest Attention

Sequential recommendation plays an increasingly important role in many e...
research
04/26/2019

Hierarchical Context enabled Recurrent Neural Network for Recommendation

A long user history inevitably reflects the transitions of personal inte...
research
02/01/2022

Sequential Search with Off-Policy Reinforcement Learning

Recent years have seen a significant amount of interests in Sequential R...
research
01/08/2023

FlexShard: Flexible Sharding for Industry-Scale Sequence Recommendation Models

Sequence-based deep learning recommendation models (DLRMs) are an emergi...
research
05/02/2019

Lifelong Sequential Modeling with Personalized Memorization for User Response Prediction

User response prediction, which models the user preference w.r.t. the pr...
research
11/04/2021

Sequential Movie Genre Prediction using Average Transition Probability with Clustering

In recent movie recommendations, predicting the user's sequential behavi...

Please sign up or login with your details

Forgot password? Click here to reset