Exploitation of Multiple Replenishing Resources with Uncertainty

07/19/2020
by   Amos Korman, et al.
0

We consider an optimization problem in which a (single) bat aims to exploit the nectar in a set of n cacti with the objective of maximizing the expected total amount of nectar it drinks. Each cactus i ∈ [n] is characterized by a parameter r_i > 0 that determines the rate in which nectar accumulates in i. In every round, the bat can visit one cactus and drink all the nectar accumulated there since its previous visit. Furthermore, competition with other bats, that may also visit some cacti and drink their nectar, is modeled by means of a stochastic process in which cactus i is emptied in each round (independently) with probability 0 < s_i < 1. Our attention is restricted to purely-stochastic strategies that are characterized by a probability vector (p_1, …, p_n) determining the probability p_i that the bat visits cactus i in each round. We prove that for every ϵ > 0, there exists a purely-stochastic strategy that approximates the optimal purely-stochastic strategy to within a multiplicative factor of 1 + ϵ, while exploiting only a small core of cacti. Specifically, we show that it suffices to include at most 2 (1 - σ)/ϵ·σ cacti in the core, where σ = min_i ∈ [n] s_i. We also show that this upper bound on core size is asymptotically optimal as a core of a significantly smaller size cannot provide a (1 + ϵ)-approximation of the optimal purely-stochastic strategy. This means that when the competition is more intense (i.e., σ is larger), a strategy based on exploiting smaller cores will be favorable.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/07/2021

CORe: Capitalizing On Rewards in Bandit Exploration

We propose a bandit algorithm that explores purely by randomizing its pa...
research
02/04/2019

(Near) Optimal Adaptivity Gaps for Stochastic Multi-Value Probing

Consider a kidney-exchange application where we want to find a max-match...
research
02/02/2021

The Min-Max Complexity of Distributed Stochastic Convex Optimization with Intermittent Communication

We resolve the min-max complexity of distributed stochastic convex optim...
research
11/25/2017

Selling to a No-Regret Buyer

We consider the problem of a single seller repeatedly selling a single i...
research
07/17/2021

BONUS! Maximizing Surprise

Multi-round competitions often double or triple the points awarded in th...
research
03/18/2020

Malicious Experts versus the multiplicative weights algorithm in online prediction

We consider a prediction problem with two experts and a forecaster. We a...

Please sign up or login with your details

Forgot password? Click here to reset