Corruption-Robust Contextual Search through Density Updates

06/15/2022
by   Renato Paes Leme, et al.
0

We study the problem of contextual search in the adversarial noise model. Let d be the dimension of the problem, T be the time horizon and C be the total amount of noise in the system. For the -ball loss, we give a tight regret bound of O(C + d log(1/)) improving over the O(d^3 log(1/)) log^2(T) + C log(T) log(1/)) bound of Krishnamurthy et al (STOC21). For the symmetric loss, we give an efficient algorithm with regret O(C+d log T). Our techniques are a significant departure from prior approaches. Specifically, we keep track of density functions over the candidate vectors instead of a knowledge set consisting of the candidate vectors consistent with the feedback obtained.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/03/2020

Contextual Search for General Hypothesis Classes

We study a general version of the problem of online learning under binar...
research
10/07/2021

A Model Selection Approach for Corruption Robust Reinforcement Learning

We develop a model selection approach to tackle reinforcement learning w...
research
05/31/2020

Improved Regret for Zeroth-Order Adversarial Bandit Convex Optimisation

We prove that the information-theoretic upper bound on the minimax regre...
research
09/07/2021

Learning to Bid in Contextual First Price Auctions

In this paper, we investigate the problem about how to bid in repeated c...
research
03/02/2023

Efficient Rate Optimal Regret for Adversarial Contextual MDPs Using Online Function Approximation

We present the OMG-CMDP! algorithm for regret minimization in adversaria...
research
11/27/2022

Counterfactual Optimism: Rate Optimal Regret for Stochastic Contextual MDPs

We present the UC^3RL algorithm for regret minimization in Stochastic Co...
research
09/10/2019

Optimality of the Subgradient Algorithm in the Stochastic Setting

Recently Jaouad Mourtada and Stéphane Gaïffas showed the anytime hedge a...

Please sign up or login with your details

Forgot password? Click here to reset