Fast Calculation of the Knowledge Gradient for Optimization of Deterministic Engineering Simulations

08/16/2016
by   Joachim van der Herten, et al.
0

A novel efficient method for computing the Knowledge-Gradient policy for Continuous Parameters (KGCP) for deterministic optimization is derived. The differences with Expected Improvement (EI), a popular choice for Bayesian optimization of deterministic engineering simulations, are explored. Both policies and the Upper Confidence Bound (UCB) policy are compared on a number of benchmark functions including a problem from structural dynamics. It is empirically shown that KGCP has similar performance as the EI policy for many problems, but has better convergence properties for complex (multi-modal) optimization problems as it emphasizes more on exploration when the model is confident about the shape of optimal regions. In addition, the relationship between Maximum Likelihood Estimation (MLE) and slice sampling for estimation of the hyperparameters of the underlying models, and the complexity of the problem at hand, is studied.

READ FULL TEXT
research
04/17/2022

Randomized Maximum Likelihood via High-Dimensional Bayesian Optimization

Randomized Maximum Likelihood (RML) is an approximate posterior sampling...
research
06/05/2016

Relaxation of the EM Algorithm via Quantum Annealing

The EM algorithm is a novel numerical method to obtain maximum likelihoo...
research
06/06/2020

Doubly Robust Off-Policy Value and Gradient Estimation for Deterministic Policies

Offline reinforcement learning, wherein one uses off-policy data logged ...
research
05/21/2020

Global Optimization of Gaussian processes

Gaussian processes (Kriging) are interpolating data-driven models that a...
research
11/05/2019

Designing over uncertain outcomes with stochastic sampling Bayesian optimization

Optimization is becoming increasingly common in scientific and engineeri...
research
03/18/2015

Differentiating the multipoint Expected Improvement for optimal batch design

This work deals with parallel optimization of expensive objective functi...
research
02/23/2023

Parameter-free shape optimization: various shape updates for engineering applications

In the last decade, parameter-free approaches to shape optimization prob...

Please sign up or login with your details

Forgot password? Click here to reset