Time-based Sequence Model for Personalization and Recommendation Systems

by   Tigran Ishkhanov, et al.

In this paper we develop a novel recommendation model that explicitly incorporates time information. The model relies on an embedding layer and TSL attention-like mechanism with inner products in different vector spaces, that can be thought of as a modification of multi-headed attention. This mechanism allows the model to efficiently treat sequences of user behavior of different length. We study the properties of our state-of-the-art model on statistically designed data set. Also, we show that it outperforms more complex models with longer sequence length on the Taobao User Behavior dataset.


page 1

page 2

page 3

page 4


Personalizing Graph Neural Networks with Attention Mechanism for Session-based Recommendation

The problem of personalized session-based recommendation aims to predict...

A Non-sequential Approach to Deep User Interest Model for CTR Prediction

Click-Through Rate (CTR) prediction plays an important role in many indu...

Big Bird: Transformers for Longer Sequences

Transformers-based models, such as BERT, have been one of the most succe...

Sparse Attentive Memory Network for Click-through Rate Prediction with Long Sequences

Sequential recommendation predicts users' next behaviors with their hist...

Recommender Transformers with Behavior Pathways

Sequential recommendation requires the recommender to capture the evolvi...

MEANTIME: Mixture of Attention Mechanisms with Multi-temporal Embeddings for Sequential Recommendation

Recently, self-attention based models have achieved state-of-the-art per...

Sequence-Based Target Coin Prediction for Cryptocurrency Pump-and-Dump

As the pump-and-dump schemes (P Ds) proliferate in the cryptocurrency ...