Efficient Lipschitzian Global Optimization of Hölder Continuous Multivariate Functions

03/24/2023
by   Kaan Gokcesu, et al.
0

This study presents an effective global optimization technique designed for multivariate functions that are Hölder continuous. Unlike traditional methods that construct lower bounding proxy functions, this algorithm employs a predetermined query creation rule that makes it computationally superior. The algorithm's performance is assessed using the average or cumulative regret, which also implies a bound for the simple regret and reflects the overall effectiveness of the approach. The results show that with appropriate parameters the algorithm attains an average regret bound of O(T^-α/n) for optimizing a Hölder continuous target function with Hölder exponent α in an n-dimensional space within a given time horizon T. We demonstrate that this bound is minimax optimal.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/06/2022

Efficient Minimax Optimal Global Optimization of Lipschitz Continuous Multivariate Functions

In this work, we propose an efficient minimax optimal global optimizatio...
research
08/24/2021

Regret Analysis of Global Optimization in Univariate Functions with Lipschitz Derivatives

In this work, we study the problem of global optimization in univariate ...
research
01/18/2022

Low Regret Binary Sampling Method for Efficient Global Optimization of Univariate Functions

In this work, we propose a computationally efficient algorithm for the p...
research
09/06/2022

1D to nD: A Meta Algorithm for Multivariate Global Optimization via Univariate Optimizers

In this work, we propose a meta algorithm that can solve a multivariate ...
research
03/30/2021

Optimal Stochastic Nonconvex Optimization with Bandit Feedback

In this paper, we analyze the continuous armed bandit problems for nonco...
research
03/21/2021

Online Convex Optimization with Continuous Switching Constraint

In many sequential decision making applications, the change of decision ...

Please sign up or login with your details

Forgot password? Click here to reset