Techniques Toward Optimizing Viewability in RTB Ad Campaigns Using Reinforcement Learning

05/21/2021
by   Michael Tashman, et al.
0

Reinforcement learning (RL) is an effective technique for training decision-making agents through interactions with their environment. The advent of deep learning has been associated with highly notable successes with sequential decision making problems - such as defeating some of the highest-ranked human players at Go. In digital advertising, real-time bidding (RTB) is a common method of allocating advertising inventory through real-time auctions. Bidding strategies need to incorporate logic for dynamically adjusting parameters in order to deliver pre-assigned campaign goals. Here we discuss techniques toward using RL to train bidding agents. As a campaign metric we particularly focused on viewability: the percentage of inventory which goes on to be viewed by an end user. This paper is presented as a survey of techniques and experiments which we developed through the course of this research. We discuss expanding our training data to include edge cases by training on simulated interactions. We discuss the experimental results comparing the performance of several promising RL algorithms, and an approach to hyperparameter optimization of an actor/critic training pipeline through Bayesian optimization. Finally, we present live-traffic tests of some of our RL agents against a rule-based feedback-control approach, demonstrating the potential for this method as well as areas for further improvement. This paper therefore presents an arrangement of our findings in this quickly developing field, and ways that it can be applied to an RTB use case.

READ FULL TEXT
research
04/21/2022

Optimizing Nitrogen Management with Deep Reinforcement Learning and Crop Simulations

Nitrogen (N) management is critical to sustain soil fertility and crop p...
research
08/03/2022

AACC: Asymmetric Actor-Critic in Contextual Reinforcement Learning

Reinforcement Learning (RL) techniques have drawn great attention in man...
research
06/24/2022

Value Function Decomposition for Iterative Design of Reinforcement Learning Agents

Designing reinforcement learning (RL) agents is typically a difficult pr...
research
08/02/2021

Optimizing Cost per Click for Digital Advertising Campaigns

Cost per click is a common metric to judge digital advertising campaign ...
research
09/17/2021

Accelerating Offline Reinforcement Learning Application in Real-Time Bidding and Recommendation: Potential Use of Simulation

In recommender systems (RecSys) and real-time bidding (RTB) for online a...
research
03/10/2021

Using Cognitive Models to Train Warm Start Reinforcement Learning Agents for Human-Computer Interactions

Reinforcement learning (RL) agents in human-computer interactions applic...
research
10/11/2021

Bid Optimization using Maximum Entropy Reinforcement Learning

Real-time bidding (RTB) has become a critical way of online advertising....

Please sign up or login with your details

Forgot password? Click here to reset