End-to-End User Behavior Retrieval in Click-Through RatePrediction Model

08/10/2021
by   Qiwei Chen, et al.
0

Click-Through Rate (CTR) prediction is one of the core tasks in recommender systems (RS). It predicts a personalized click probability for each user-item pair. Recently, researchers have found that the performance of CTR model can be improved greatly by taking user behavior sequence into consideration, especially long-term user behavior sequence. The report on an e-commerce website shows that 23% of users have more than 1000 clicks during the past 5 months. Though there are numerous works focus on modeling sequential user behaviors, few works can handle long-term user behavior sequence due to the strict inference time constraint in real world system. Two-stage methods are proposed to push the limit for better performance. At the first stage, an auxiliary task is designed to retrieve the top-k similar items from long-term user behavior sequence. At the second stage, the classical attention mechanism is conducted between the candidate item and k items selected in the first stage. However, information gap happens between retrieval stage and the main CTR task. This goal divergence can greatly diminishing the performance gain of long-term user sequence. In this paper, inspired by Reformer, we propose a locality-sensitive hashing (LSH) method called ETA (End-to-end Target Attention) which can greatly reduce the training and inference cost and make the end-to-end training with long-term user behavior sequence possible. Both offline and online experiments confirm the effectiveness of our model. We deploy ETA into a large-scale real world E-commerce system and achieve extra 3.1% improvements on GMV (Gross Merchandise Value) compared to a two-stage long user sequence CTR model.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/20/2022

Sampling Is All You Need on Modeling Long-Term User Behaviors for CTR Prediction

Rich user behavior data has been proven to be of great value for Click-T...
research
09/25/2022

Efficient Long Sequential User Data Modeling for Click-Through Rate Prediction

Recent studies on Click-Through Rate (CTR) prediction has reached new le...
research
06/26/2022

A Pre-Computing Solution for Online Advertising Serving

Click-Through Rate (CTR) prediction plays a key role in online advertisi...
research
04/28/2020

CmnRec: Sequential Recommendations with Chunk-accelerated Memory Network

Recently, Memory-based Neural Recommenders (MNR) have demonstrated super...
research
04/25/2022

Adversarial Filtering Modeling on Long-term User Behavior Sequences for Click-Through Rate Prediction

Rich user behavior information is of great importance for capturing and ...
research
05/02/2019

Lifelong Sequential Modeling with Personalized Memorization for User Response Prediction

User response prediction, which models the user preference w.r.t. the pr...
research
06/07/2021

DMBGN: Deep Multi-Behavior Graph Networks for Voucher Redemption Rate Prediction

In E-commerce, vouchers are important marketing tools to enhance users' ...

Please sign up or login with your details

Forgot password? Click here to reset