Regret analysis of the Piyavskii-Shubert algorithm for global Lipschitz optimization

02/06/2020
by   Clément Bouttier, et al.
0

We consider the problem of maximizing a non-concave Lipschitz multivariate function f over a compact domain. We provide regret guarantees (i.e., optimization error bounds) for a very natural algorithm originally designed by Piyavskii and Shubert in 1972. Our results hold in a general setting in which values of f can only be accessed approximately. In particular, they yield state-of-the-art regret bounds both when f is observed exactly and when evaluations are perturbed by an independent subgaussian noise.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/29/2021

Regret Bounds for Gaussian-Process Optimization in Large Domains

The goal of this paper is to characterize Gaussian-Process optimization ...
research
08/24/2021

Regret Analysis of Global Optimization in Univariate Functions with Lipschitz Derivatives

In this work, we study the problem of global optimization in univariate ...
research
06/06/2022

Efficient Minimax Optimal Global Optimization of Lipschitz Continuous Multivariate Functions

In this work, we propose an efficient minimax optimal global optimizatio...
research
09/06/2022

1D to nD: A Meta Algorithm for Multivariate Global Optimization via Univariate Optimizers

In this work, we propose a meta algorithm that can solve a multivariate ...
research
06/07/2016

Regret Bounds for Non-decomposable Metrics with Missing Labels

We consider the problem of recommending relevant labels (items) for a gi...
research
06/13/2020

Follow the Perturbed Leader: Optimism and Fast Parallel Algorithms for Smooth Minimax Games

We consider the problem of online learning and its application to solvin...
research
05/27/2022

A gradient estimator via L1-randomization for online zero-order optimization with two point feedback

This work studies online zero-order optimization of convex and Lipschitz...

Please sign up or login with your details

Forgot password? Click here to reset