The Best of Many Worlds: Dual Mirror Descent for Online Allocation Problems

by   Santiago Balseiro, et al.

Online allocation problems with resource constraints are central problems in revenue management and online advertising. In these problems, requests arrive sequentially during a finite horizon and, for each request, a decision maker needs to choose an action that consumes a certain amount of resources and generates reward. The objective is to maximize cumulative rewards subject to a constraint on the total consumption of resources. In this paper, we consider a data-driven setting in which the reward and resource consumption of each request are generated using an input model that is unknown to the decision maker. We design a general class of algorithms that attain good performance in various inputs models without knowing which type of input they are facing. In particular, our algorithms are asymptotically optimal under stochastic i.i.d. input model as well as various non-stationary stochastic input models, and they attain an asymptotically optimal fixed competitive ratio when the input is adversarial. Our algorithms operate in the Lagrangian dual space: they maintain a dual multiplier for each resource that is updated using online mirror descent. By choosing the reference function accordingly, we recover dual sub-gradient descent and dual exponential weights algorithm. The resulting algorithms are simple, fast, and have minimal requirements on the reward functions, consumption functions and the action space, in contrast to existing methods for online allocation problems. We discuss applications to network revenue management, online bidding in repeated auctions with budget constraints, online proportional matching with high entropy, and personalized assortment optimization with limited inventories.


page 1

page 2

page 3

page 4


Online Resource Allocation under Horizon Uncertainty

We study stochastic online resource allocation: a decision maker needs t...

Regularized Online Allocation Problems: Fairness and Beyond

Online allocation problems with resource constraints have a rich history...

Online Stochastic Optimization with Wasserstein Based Non-stationarity

We consider a general online stochastic optimization problem with multip...

Optimal Regularized Online Convex Allocation by Adaptive Re-Solving

This paper introduces a dual-based algorithm framework for solving the r...

Online Allocation with Two-sided Resource Constraints

Motivated by many interesting real-world applications in logistics and o...

Online Learning and Matching for Resource Allocation Problems

In order for an e-commerce platform to maximize its revenue, it must rec...

Online Learning with Knapsacks: the Best of Both Worlds

We study online learning problems in which a decision maker wants to max...

Please sign up or login with your details

Forgot password? Click here to reset