A General Framework for Constrained Bayesian Optimization using Information-based Search

We present an information-theoretic framework for solving global black-box optimization problems that also have black-box constraints. Of particular interest to us is to efficiently solve problems with decoupled constraints, in which subsets of the objective and constraint functions may be evaluated independently. For example, when the objective is evaluated on a CPU and the constraints are evaluated independently on a GPU. These problems require an acquisition function that can be separated into the contributions of the individual function evaluations. We develop one such acquisition function and call it Predictive Entropy Search with Constraints (PESC). PESC is an approximation to the expected information gain criterion and it compares favorably to alternative approaches based on improvement in several synthetic and real-world problems. In addition to this, we consider problems with a mix of functions that are fast and slow to evaluate. These problems require balancing the amount of time spent in the meta-computation of PESC and in the actual evaluation of the target objective. We take a bounded rationality approach and develop partial update for PESC which trades off accuracy against speed. We then propose a method for adaptively switching between the partial and full updates for PESC. This allows us to interpolate between versions of PESC that are efficient in terms of function evaluations and those that are efficient in terms of wall-clock time. Overall, we demonstrate that PESC is an effective algorithm that provides a promising direction towards a unified solution for constrained Bayesian optimization.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/18/2015

Predictive Entropy Search for Bayesian Optimization with Unknown Constraints

Unknown constraints arise in many types of expensive black-box optimizat...
research
03/22/2014

Bayesian Optimization with Unknown Constraints

Recent work on Bayesian optimization has shown its effectiveness in glob...
research
10/15/2019

Constrained Bayesian Optimization with Max-Value Entropy Search

Bayesian optimization (BO) is a model-based approach to sequentially opt...
research
03/09/2021

A sampling criterion for constrained Bayesian optimization with uncertainties

We consider the problem of chance constrained optimization where it is s...
research
08/21/2021

Natural Evolution Strategy for Unconstrained and Implicitly Constrained Problems with Ridge Structure

In this paper, we propose a new natural evolution strategy for unconstra...
research
10/21/2022

Local Bayesian optimization via maximizing probability of descent

Local optimization presents a promising approach to expensive, high-dime...
research
01/04/2022

Test and Evaluation of Quadrupedal Walking Gaits through Sim2Real Gap Quantification

In this letter, the authors propose a two-step approach to evaluate and ...

Please sign up or login with your details

Forgot password? Click here to reset