Sample Complexity of an Adversarial Attack on UCB-based Best-arm Identification Policy

09/13/2022
by   Varsha Pendyala, et al.
0

In this work I study the problem of adversarial perturbations to rewards, in a Multi-armed bandit (MAB) setting. Specifically, I focus on an adversarial attack to a UCB type best-arm identification policy applied to a stochastic MAB. The UCB attack presented in [1] results in pulling a target arm K very often. I used the attack model of [1] to derive the sample complexity required for selecting target arm K as the best arm. I have proved that the stopping condition of UCB based best-arm identification algorithm given in [2], can be achieved by the target arm K in T rounds, where T depends only on the total number of arms and σ parameter of σ^2- sub-Gaussian random rewards of the arms.

READ FULL TEXT

Please sign up or login with your details

Forgot password? Click here to reset