Bayesian Optimisation vs. Input Uncertainty Reduction

05/31/2020
by   Juan Ungredda, et al.
0

Simulators often require calibration inputs estimated from real world data and the quality of the estimate can significantly affect simulation output. Particularly when performing simulation optimisation to find an optimal solution, the uncertainty in the inputs significantly affects the quality of the found solution. One remedy is to search for the solution that has the best performance on average over the uncertain range of inputs yielding an optimal compromise solution. We consider the more general setting where a user may choose between either running simulations or instead collecting real world data. A user may choose an input and a solution and observe the simulation output, or instead query an external data source improving the input estimate enabling the search for a more focused, less compromised solution. We explicitly examine the trade-off between simulation and real data collection in order to find the optimal solution of the simulator with the true inputs. Using a value of information procedure, we propose a novel unified simulation optimisation procedure called Bayesian Information Collection and Optimisation (BICO) that, in each iteration, automatically determines which of the two actions (running simulations or data collection) is more beneficial. Numerical experiments demonstrate that the proposed algorithm is able to automatically determine an appropriate balance between optimisation and data collection.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

page 3

page 4

05/08/2020

BOP-Elites, a Bayesian Optimisation algorithm for Quality-Diversity search

Quality Diversity (QD) algorithms such as MAP-Elites are a class of opti...
02/21/2019

Bayesian optimisation under uncertain inputs

Bayesian optimisation (BO) has been a successful approach to optimise fu...
11/09/2020

Statistical Uncertainty Analysis for Stochastic Simulation

When we use simulation to evaluate the performance of a stochastic syste...
12/11/2017

Surgical task-space optimisation of the CYCLOPS robotic system

The CYCLOPS is a cable-driven parallel mechanism used for minimally inva...
03/19/2010

Optimisation of a Crossdocking Distribution Centre Simulation Model

This paper reports on continuing research into the modelling of an order...
01/19/2021

Sequential Bayesian Risk Set Inference for Robust Discrete Optimization via Simulation

Optimization via simulation (OvS) procedures that assume the simulation ...
09/07/2017

Bayesian Optimisation for Safe Navigation under Localisation Uncertainty

In outdoor environments, mobile robots are required to navigate through ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.