Practical Algorithms for Best-K Identification in Multi-Armed Bandits

05/19/2017
by   Haotian Jiang, et al.
0

In the Best-K identification problem (Best-K-Arm), we are given N stochastic bandit arms with unknown reward distributions. Our goal is to identify the K arms with the largest means with high confidence, by drawing samples from the arms adaptively. This problem is motivated by various practical applications and has attracted considerable attention in the past decade. In this paper, we propose new practical algorithms for the Best-K-Arm problem, which have nearly optimal sample complexity bounds (matching the lower bound up to logarithmic factors) and outperform the state-of-the-art algorithms for the Best-K-Arm problem (even for K=1) in practice.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/13/2017

Nearly Instance Optimal Sample Complexity Bounds for Top-k Arm Selection

In the Best-k-Arm problem, we are given n stochastic bandit arms, each a...
research
06/16/2020

Finding All ε-Good Arms in Stochastic Bandits

The pure-exploration problem in stochastic multi-armed bandits aims to f...
research
06/03/2019

MaxGap Bandit: Adaptive Algorithms for Approximate Ranking

This paper studies the problem of adaptively sampling from K distributio...
research
06/04/2017

Nearly Optimal Sampling Algorithms for Combinatorial Pure Exploration

We study the combinatorial pure exploration problem Best-Set in stochast...
research
06/19/2021

Variance-Dependent Best Arm Identification

We study the problem of identifying the best arm in a stochastic multi-a...
research
06/05/2023

Covariance Adaptive Best Arm Identification

We consider the problem of best arm identification in the multi-armed ba...
research
05/20/2020

Best Arm Identification in Spectral Bandits

We study best-arm identification with fixed confidence in bandit models ...

Please sign up or login with your details

Forgot password? Click here to reset