Dynamic Pricing with Finitely Many Unknown Valuations

07/09/2018
by   Nicolò Cesa-Bianchi, et al.
0

Motivated by posted price auctions where buyers are grouped in an unknown number of latent types characterized by their private values for the good on sale, we investigate revenue maximization in stochastic dynamic pricing when the distribution of buyers' private values is supported on an unknown set of points in [0,1] of unknown cardinality K. This setting can be viewed as an instance of a stochastic K-armed bandit problem where the location of the arms (the K unknown valuations) must be learned as well. In the distribution-free case, we show that our setting is just as hard as K-armed stochastic bandits: we prove that no algorithm can achieve a regret significantly better than √(KT), (where T is the time horizon) and present an efficient algorithm matching this lower bound up to logarithmic factors. In the distribution-dependent case, we show that for all K>2 our setting is strictly harder than K-armed stochastic bandits by proving that it is impossible to obtain regret bounds that grow logarithmically in time or slower. On the other hand, when a lower bound γ>0 on the smallest drop in the demand curve is known, we prove an upper bound on the regret of order (1/Δ+( T)/γ^2)(K T). This is a significant improvement on previously known regret bounds for discontinuous demand curves, that are at best of order (K^12/γ^8)√(T). When K=2 in the distribution-dependent case, the hardness of our setting reduces to that of a stochastic 2-armed bandit: we prove that an upper bound of order ( T)/Δ (up to factors) on the regret can be achieved with no information on the demand curve. Finally, we show a O(√(T)) upper bound on the regret for the setting in which the buyers' decisions are nonstochastic, and the regret is measured with respect to the best between two fixed valuations one of which is known to the seller.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/14/2018

KL-UCB-switch: optimal regret bounds for stochastic bandits from both a distribution-dependent and a distribution-free viewpoints

In the context of K-armed stochastic bandits with distribution only assu...
research
03/09/2021

Dynamic Pricing and Learning under the Bass Model

We consider a novel formulation of the dynamic pricing and demand learni...
research
10/22/2015

Inventory Control Involving Unknown Demand of Discrete Nonperishable Items - Analysis of a Newsvendor-based Policy

Inventory control with unknown demand distribution is considered, with e...
research
06/05/2020

Adaptation to the Range in K-Armed Bandits

We consider stochastic bandit problems with K arms, each associated with...
research
02/14/2022

The Impact of Batch Learning in Stochastic Linear Bandits

We consider a special case of bandit problems, named batched bandits, in...
research
09/13/2021

Policy Optimization Using Semiparametric Models for Dynamic Pricing

In this paper, we study the contextual dynamic pricing problem where the...
research
05/26/2017

Online Auctions and Multi-scale Online Learning

We consider revenue maximization in online auctions and pricing. A selle...

Please sign up or login with your details

Forgot password? Click here to reset