Max-value Entropy Search for Efficient Bayesian Optimization

03/06/2017
by   Zi Wang, et al.
0

Entropy Search (ES) and Predictive Entropy Search (PES) are popular and empirically successful Bayesian Optimization techniques. Both rely on a compelling information-theoretic motivation, and maximize the information gained about the of the unknown function. Yet, both are plagued by expensive computation, e.g., for estimating entropy. We propose a new criterion, Max-value Entropy Search (MES), that instead uses the information about the maximum value. We observe that MES maintains or improves the good empirical performance of ES/PES, while tremendously lightening the computational burden. In particular, MES is much more robust to the number of samples used for computing entropy, and hence more efficient. We show relations of MES to other BO methods, and establish a regret bound. Empirical evaluations on a variety of tasks demonstrate the good performance of MES.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/09/2022

Joint Entropy Search For Maximally-Informed Bayesian Optimization

Information-theoretic Bayesian optimization techniques have become popul...
research
01/24/2019

Multi-fidelity Bayesian Optimization with Max-value Entropy Search

Bayesian optimization (BO) is an effective tool for black-box optimizati...
research
02/02/2016

Minimum Regret Search for Single- and Multi-Task Optimization

We propose minimum regret search (MRS), a novel acquisition function for...
research
11/13/2015

Active Contextual Entropy Search

Contextual policy search allows adapting robotic movement primitives to ...
research
03/10/2023

Gaussian Max-Value Entropy Search for Multi-Agent Bayesian Optimization

We study the multi-agent Bayesian optimization (BO) problem, where multi...
research
02/28/2022

Rectified Max-Value Entropy Search for Bayesian Optimization

Although the existing max-value entropy search (MES) is based on the wid...
research
07/24/2019

Classified Regression for Bayesian Optimization: Robot Learning with Unknown Penalties

Learning robot controllers by minimizing a black-box objective cost usin...

Please sign up or login with your details

Forgot password? Click here to reset