Deep Reinforcement Learning for Online Advertising in Recommender Systems

09/09/2019
by   Xiangyu Zhao, et al.
0

With the recent prevalence of Reinforcement Learning (RL), there have been tremendous interests in utilizing RL for online advertising in recommendation platforms (e.g. e-commerce and news feed sites). However, most RL-based advertising algorithms focus on solely optimizing the revenue of ads while ignoring possible negative influence of ads on user experience of recommended items (products, articles and videos). Developing an optimal advertising algorithm in recommendations faces immense challenges because interpolating ads improperly or too frequently may decrease user experience, while interpolating fewer ads will reduce the advertising revenue. Thus, in this paper, we propose a novel advertising strategy for the rec/ads trade-off. To be specific, we develop a reinforcement learning based framework that can continuously update its advertising strategies and maximize reward in the long run. Given a recommendation list, we design a novel Deep Q-network architecture that can determine three internally related tasks jointly, i.e., (i) whether to interpolate an ad or not in the recommendation list, and if yes, (ii) the optimal ad and (iii) the optimal location to interpolate. The experimental results based on real-world data demonstrate the effectiveness of the proposed framework.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/28/2020

Jointly Learning to Recommend and Advertise

Online recommendation and advertising are two major income channels for ...
research
12/01/2016

Large-scale Validation of Counterfactual Learning Methods: A Test-Bed

The ability to perform effective off-policy learning would revolutionize...
research
02/11/2019

Model-Based Reinforcement Learning for Whole-Chain Recommendations

With the recent prevalence of Reinforcement Learning (RL), there have be...
research
06/27/2019

Toward Simulating Environments in Reinforcement Learning Based Recommendations

With the recent advances in Reinforcement Learning (RL), there have been...
research
12/18/2018

Deep Reinforcement Learning for Search, Recommendation, and Online Advertising: A Survey

Search, recommendation, and advertising are the three most important inf...
research
02/03/2019

Value-aware Recommendation based on Reinforced Profit Maximization in E-commerce Systems

Existing recommendation algorithms mostly focus on optimizing traditiona...
research
08/19/2019

Learning to Advertise for Organic Traffic Maximization in E-Commerce Product Feeds

Most e-commerce product feeds provide blended results of advertised prod...

Please sign up or login with your details

Forgot password? Click here to reset