Bayesian Optimization for Min Max Optimization

07/29/2021
by   Dorina Weichert, et al.
0

A solution that is only reliable under favourable conditions is hardly a safe solution. Min Max Optimization is an approach that returns optima that are robust against worst case conditions. We propose algorithms that perform Min Max Optimization in a setting where the function that should be optimized is not known a priori and hence has to be learned by experiments. Therefore we extend the Bayesian Optimization setting, which is tailored to maximization problems, to Min Max Optimization problems. While related work extends the two acquisition functions Expected Improvement and Gaussian Process Upper Confidence Bound; we extend the two acquisition functions Entropy Search and Knowledge Gradient. These acquisition functions are able to gain knowledge about the optimum instead of just looking for points that are supposed to be optimal. In our evaluation we show that these acquisition functions allow for better solutions - converging faster to the optimum than the benchmark settings.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/07/2019

Knowing The What But Not The Where in Bayesian Optimization

Bayesian optimization has demonstrated impressive success in finding the...
research
02/28/2022

Rectified Max-Value Entropy Search for Bayesian Optimization

Although the existing max-value entropy search (MES) is based on the wid...
research
10/15/2019

Constrained Bayesian Optimization with Max-Value Entropy Search

Bayesian optimization (BO) is a model-based approach to sequentially opt...
research
12/01/2017

The reparameterization trick for acquisition functions

Bayesian optimization is a sample-efficient approach to solving global o...
research
10/10/2018

Combining Bayesian Optimization and Lipschitz Optimization

Bayesian optimization and Lipschitz optimization have developed alternat...
research
01/25/2020

Bayesian optimization for backpropagation in Monte-Carlo tree search

In large domains, Monte-Carlo tree search (MCTS) is required to estimate...
research
03/18/2021

Modeling the Second Player in Distributionally Robust Optimization

Distributionally robust optimization (DRO) provides a framework for trai...

Please sign up or login with your details

Forgot password? Click here to reset