Corruption-Robust Lipschitz Contextual Search

07/26/2023
by   Shiliang Zuo, et al.
0

I study the problem of learning a Lipschitz function with corrupted binary signals. The learner tries to learn a Lipschitz function f that the adversary chooses. In each round, the adversary selects a context vector x_t in the input space, and the learner makes a guess to the true function value f(x_t) and receives a binary signal indicating whether the guess was high or low. In a total of C rounds, the signal may be corrupted, though the value of C is unknown to the learner. The learner's goal is to incur a small cumulative loss. I present a natural yet powerful technique sanity check, which proves useful in designing corruption-robust algorithms. I design algorithms which (treating the Lipschitz parameter L as constant): for the symmetric loss, the learner achieves regret O(Clog T) with d = 1 and O_d(Clog T + T^(d-1)/d) with d > 1; for the pricing loss the learner achieves regret O (T^d/(d+1) + C· T^1/(d+1)).

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/09/2018

Contextual Search via Intrinsic Volumes

We study the problem of contextual search, a multidimensional generaliza...
research
08/09/2021

Online Multiobjective Minimax Optimization and Applications

We introduce a simple but general online learning framework, in which at...
research
08/24/2021

Regret Analysis of Global Optimization in Univariate Functions with Lipschitz Derivatives

In this work, we study the problem of global optimization in univariate ...
research
01/18/2022

Low Regret Binary Sampling Method for Efficient Global Optimization of Univariate Functions

In this work, we propose a computationally efficient algorithm for the p...
research
10/17/2016

Risk-Aware Algorithms for Adversarial Contextual Bandits

In this work we consider adversarial contextual bandits with risk constr...
research
05/29/2023

Robust Lipschitz Bandits to Adversarial Corruptions

Lipschitz bandit is a variant of stochastic bandits that deals with a co...
research
02/26/2020

Corrupted Multidimensional Binary Search: Learning in the Presence of Irrational Agents

Standard game-theoretic formulations for settings like contextual pricin...

Please sign up or login with your details

Forgot password? Click here to reset