Search-based User Interest Modeling with Lifelong Sequential Behavior Data for Click-Through Rate Prediction

06/10/2020
by   Pi Qi, et al.
0

Rich user behavior data has been proven to be of great value for click-through rate prediction tasks, especially in industrial applications such as recommender systems and online advertising. Both industry and academy have paid much attention to this topic and propose different approaches to modeling with long sequential user behavior data. Among them, memory network based model MIMN proposed by Alibaba, achieves SOTA with the co-design of both learning algorithm and serving system. MIMN is the first industrial solution that can model sequential user behavior data with length scaling up to 1000. However, MIMN fails to precisely capture user interests given a specific candidate item when the length of user behavior sequence increases further, say, by 10 times or more. This challenge exists widely in previously proposed approaches. In this paper, we tackle this problem by designing a new modeling paradigm, which we name as Search-based Interest Model (SIM). SIM extracts user interests with two cascaded search units: (i) General Search Unit acts as a general search from the raw and arbitrary long sequential behavior data, with query information from candidate item, and gets a Sub user Behavior Sequence which is relevant to candidate item; (ii) Exact Search Unit models the precise relationship between candidate item and SBS. This cascaded search paradigm enables SIM with a better ability to model lifelong sequential behavior data in both scalability and accuracy. Apart from the learning algorithm, we also introduce our hands-on experience on how to implement SIM in large scale industrial systems. Since 2019, SIM has been deployed in the display advertising system in Alibaba, bringing 7.1% CTR and 4.4% RPM lift, which is significant to the business. Serving the main traffic in our real system now, SIM models user behavior data with maximum length reaching up to 54000, pushing SOTA to 54x.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/22/2019

Practice on Long Sequential User Behavior Modeling for Click-Through Rate Prediction

Click-through rate (CTR) prediction is critical for industrial applicati...
research
08/11/2023

Deep Context Interest Network for Click-Through Rate Prediction

Click-Through Rate (CTR) prediction, estimating the probability of a use...
research
05/20/2022

Sampling Is All You Need on Modeling Long-Term User Behaviors for CTR Prediction

Rich user behavior data has been proven to be of great value for Click-T...
research
12/27/2020

Multi-Channel Sequential Behavior Networks for User Modeling in Online Advertising

Multiple content providers rely on native advertisement for revenue by p...
research
06/21/2017

Deep Interest Network for Click-Through Rate Prediction

To better extract users' interest by exploiting the rich historical beha...
research
04/05/2021

A Non-sequential Approach to Deep User Interest Model for CTR Prediction

Click-Through Rate (CTR) prediction plays an important role in many indu...
research
02/16/2023

Neighbor Based Enhancement for the Long-Tail Ranking Problem in Video Rank Models

Rank models play a key role in industrial recommender systems, advertisi...

Please sign up or login with your details

Forgot password? Click here to reset