A Simple Unified Framework for High Dimensional Bandit Problems

02/18/2021
by   Wenjie Li, et al.
0

Stochastic high dimensional bandit problems with low dimensional structure are useful in different applications such as online advertising and drug discovery. In this work, we propose a simple unified algorithm for such problems and present a general analysis framework for the regret upper bound of our algorithm. We show that under some mild unified assumptions, our algorithm can be applied to different high dimensional bandit problems. Our framework utilizes the low dimensional structure to guide the parameter estimation in the problem, therefore our algorithm achieves the best regret bounds in the LASSO bandit, better bounds in the low-rank matrix bandit and the group sparse matrix bandit, as well as a novel bound in the multi-agent LASSO bandit.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/04/2020

Low-Rank Generalized Linear Bandit Problems

In a low-rank linear bandit problem, the reward of an action (represente...
research
09/17/2022

Advertising Media and Target Audience Optimization via High-dimensional Bandits

We present a data-driven algorithm that advertisers can use to automate ...
research
09/14/2023

Doubly High-Dimensional Contextual Bandits: An Interpretable Model for Joint Assortment-Pricing

Key challenges in running a retail business include how to select produc...
research
05/06/2023

On High-dimensional and Low-rank Tensor Bandits

Most existing studies on linear bandits focus on the one-dimensional cha...
research
07/22/2022

High dimensional stochastic linear contextual bandit with missing covariates

Recent works in bandit problems adopted lasso convergence theory in the ...
research
09/29/2020

Online Action Learning in High Dimensions: A New Exploration Rule for Contextual ε_t-Greedy Heuristics

Bandit problems are pervasive in various fields of research and are also...
research
01/08/2019

Bilinear Bandits with Low-rank Structure

We introduce the bilinear bandit problem with low-rank structure where a...

Please sign up or login with your details

Forgot password? Click here to reset