Log In Sign Up

Combinatorial Keyword Recommendations for Sponsored Search with Deep Reinforcement Learning

by   Zhipeng Li, et al.

In sponsored search, keyword recommendations help advertisers to achieve much better performance within limited budget. Many works have been done to mine numerous candidate keywords from search logs or landing pages. However, the strategy to select from given candidates remains to be improved. The existing relevance-based, popularity-based and regular combinatorial strategies fail to take the internal or external competitions among keywords into consideration. In this paper, we regard keyword recommendations as a combinatorial optimization problem and solve it with a modified pointer network structure. The model is trained on an actor-critic based deep reinforcement learning framework. A pre-clustering method called Equal Size K-Means is proposed to accelerate the training and testing procedure on the framework by reducing the action space. The performance of framework is evaluated both in offline and online environments, and remarkable improvements can be observed.


page 1

page 2

page 3

page 4


Quotient Space-Based Keyword Retrieval in Sponsored Search

Synonymous keyword retrieval has become an important problem for sponsor...

Reinforcement Learning with Combinatorial Actions: An Application to Vehicle Routing

Value-function-based methods have long played an important role in reinf...

Energy Minimization in UAV-Aided Networks: Actor-Critic Learning for Constrained Scheduling Optimization

In unmanned aerial vehicle (UAV) applications, the UAV's limited energy ...

Efficient Eligibility Traces for Deep Reinforcement Learning

Eligibility traces are an effective technique to accelerate reinforcemen...

Keyword Targeting Optimization in Sponsored Search Advertising: Combining Selection and Matching

In sponsored search advertising (SSA), advertisers need to select keywor...

Diversifying Relevant Phrases

Diverse keyword suggestions for a given landing page or matching queries...