Efficient Adaptive Regret Minimization

07/01/2022
by   Zhou Lu, et al.
0

In online convex optimization the player aims to minimize her regret against a fixed comparator over the entire repeated game. Algorithms that minimize standard regret may converge to a fixed decision, which is undesireable in changing or dynamic environments. This motivates the stronger metric of adaptive regret, or the maximum regret over any continuous sub-interval in time. Existing adaptive regret algorithms suffer from a computational penalty - typically on the order of a multiplicative factor that grows logarithmically in the number of game iterations. In this paper we show how to reduce this computational penalty to be doubly logarithmic in the number of game iterations, and with minimal degradation to the optimal attainable adaptive regret bounds.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/06/2020

Minimizing Dynamic Regret and Adaptive Regret Simultaneously

Regret minimization is treated as the golden rule in the traditional stu...
research
04/26/2019

Adaptive Regret of Convex and Smooth Functions

We investigate online convex optimization in changing environments, and ...
research
07/21/2023

An Efficient Interior-Point Method for Online Convex Optimization

A new algorithm for regret minimization in online convex optimization is...
research
07/09/2018

Online Scoring with Delayed Information: A Convex Optimization Viewpoint

We consider a system where agents enter in an online fashion and are eva...
research
01/23/2019

Online Adaptive Principal Component Analysis and Its extensions

We propose algorithms for online principal component analysis (PCA) and ...
research
03/16/2016

Regret Minimization in Repeated Games: A Set-Valued Dynamic Programming Approach

The regret-minimization paradigm has emerged as an effective technique f...
research
03/21/2020

A new regret analysis for Adam-type algorithms

In this paper, we focus on a theory-practice gap for Adam and its varian...

Please sign up or login with your details

Forgot password? Click here to reset