Rectified Max-Value Entropy Search for Bayesian Optimization

02/28/2022
by   Quoc Phong Nguyen, et al.
10

Although the existing max-value entropy search (MES) is based on the widely celebrated notion of mutual information, its empirical performance can suffer due to two misconceptions whose implications on the exploration-exploitation trade-off are investigated in this paper. These issues are essential in the development of future acquisition functions and the improvement of the existing ones as they encourage an accurate measure of the mutual information such as the rectified MES (RMES) acquisition function we develop in this work. Unlike the evaluation of MES, we derive a closed-form probability density for the observation conditioned on the max-value and employ stochastic gradient ascent with reparameterization to efficiently optimize RMES. As a result of a more principled acquisition function, RMES shows a consistent improvement over MES in several synthetic function benchmarks and real-world optimization problems.

READ FULL TEXT
research
02/19/2021

Sequential- and Parallel- Constrained Max-value Entropy Search via Information Lower Bound

Recently, several Bayesian optimization (BO) methods have been extended ...
research
10/15/2019

Constrained Bayesian Optimization with Max-Value Entropy Search

Bayesian optimization (BO) is a model-based approach to sequentially opt...
research
03/10/2023

Gaussian Max-Value Entropy Search for Multi-Agent Bayesian Optimization

We study the multi-agent Bayesian optimization (BO) problem, where multi...
research
07/29/2021

Bayesian Optimization for Min Max Optimization

A solution that is only reliable under favourable conditions is hardly a...
research
03/06/2017

Max-value Entropy Search for Efficient Bayesian Optimization

Entropy Search (ES) and Predictive Entropy Search (PES) are popular and ...
research
11/12/2021

Multi-Step Budgeted Bayesian Optimization with Unknown Evaluation Costs

Bayesian optimization (BO) is a sample-efficient approach to optimizing ...
research
11/28/2019

Greed is Good: Exploration and Exploitation Trade-offs in Bayesian Optimisation

The performance of acquisition functions for Bayesian optimisation is in...

Please sign up or login with your details

Forgot password? Click here to reset