Optimizing Sponsored Search Ranking Strategy by Deep Reinforcement Learning

03/20/2018
by   Li He, et al.
0

Sponsored search is an indispensable business model and a major revenue contributor of almost all the search engines. From the advertisers' side, participating in ranking the search results by paying for the sponsored search advertisement to attract more awareness and purchase facilitates their commercial goal. From the users' side, presenting personalized advertisement reflecting their propensity would make their online search experience more satisfactory. Sponsored search platforms rank the advertisements by a ranking function to determine the list of advertisements to show and the charging price for the advertisers. Hence, it is crucial to find a good ranking function which can simultaneously satisfy the platform, the users and the advertisers. Moreover, advertisements showing positions under different queries from different users may associate with advertisement candidates of different bid price distributions and click probability distributions, which requires the ranking functions to be optimized adaptively to the traffic characteristics. In this work, we proposed a generic framework to optimize the ranking functions by deep reinforcement learning methods. The framework is composed of two parts: an offline learning part which initializes the ranking functions by learning from a simulated advertising environment, allowing adequate exploration of the ranking function parameter space without hurting the performance of the commercial platform. An online learning part which further optimizes the ranking functions by adapting to the online data distribution. Experimental results on a large-scale sponsored search platform confirm the effectiveness of the proposed method.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/21/2022

Dynamic Reserve Price Design for Lazada Sponsored Search

In ecommerce platform, users will be less likely to use organic search i...
research
06/07/2020

SERank: Optimize Sequencewise Learning to Rank Using Squeeze-and-Excitation Network

Learning-to-rank (LTR) is a set of supervised machine learning algorithm...
research
07/16/2021

Imitate TheWorld: A Search Engine Simulation Platform

Recent E-commerce applications benefit from the growth of deep learning ...
research
08/05/2020

Optimizing AD Pruning of Sponsored Search with Reinforcement Learning

Industrial sponsored search system (SSS) can be logically divided into t...
research
02/03/2019

Value-aware Recommendation based on Reinforced Profit Maximization in E-commerce Systems

Existing recommendation algorithms mostly focus on optimizing traditiona...
research
05/22/2022

Ada-Ranker: A Data Distribution Adaptive Ranking Paradigm for Sequential Recommendation

A large-scale recommender system usually consists of recall and ranking ...
research
09/19/2022

Learning To Rank Diversely

Airbnb is a two-sided marketplace, bringing together hosts who own listi...

Please sign up or login with your details

Forgot password? Click here to reset