No-regret Learning in Repeated First-Price Auctions with Budget Constraints

05/29/2022
by   Rui Ai, et al.
0

Recently the online advertising market has exhibited a gradual shift from second-price auctions to first-price auctions. Although there has been a line of works concerning online bidding strategies in first-price auctions, it still remains open how to handle budget constraints in the problem. In the present paper, we initiate the study for a buyer with budgets to learn online bidding strategies in repeated first-price auctions. We propose an RL-based bidding algorithm against the optimal non-anticipating strategy under stationary competition. Our algorithm obtains O(√(T))-regret if the bids are all revealed at the end of each round. With the restriction that the buyer only sees the winning bid after each round, our modified algorithm obtains O(T^7/12)-regret by techniques developed from survival analysis. Our analysis extends to the more general scenario where the buyer has any bounded instantaneous utility function with regrets of the same order.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/26/2023

Learning to Bid in Repeated First-Price Auctions with Budgets

Budget management strategies in repeated auctions have received growing ...
research
02/02/2023

Online Bidding in Repeated Non-Truthful Auctions under Budget and ROI Constraints

Online advertising platforms typically use auction mechanisms to allocat...
research
07/16/2021

Bidding and Pricing in Budget and ROI Constrained Markets

In online advertising markets, setting budget and return on investment (...
research
07/05/2021

Fast Rate Learning in Stochastic First Price Bidding

First-price auctions have largely replaced traditional bidding approache...
research
04/30/2018

Learning Optimal Reserve Price against Non-myopic Bidders

We consider the problem of learning optimal reserve price in repeated au...
research
02/20/2015

Low-Cost Learning via Active Data Procurement

We design mechanisms for online procurement of data held by strategic ag...
research
11/05/2022

Leveraging the Hints: Adaptive Bidding in Repeated First-Price Auctions

With the advent and increasing consolidation of e-commerce, digital adve...

Please sign up or login with your details

Forgot password? Click here to reset