Bayesian Optimization Augmented with Actively Elicited Expert Knowledge

08/18/2022
by   Daolang Huang, et al.
0

Bayesian optimization (BO) is a well-established method to optimize black-box functions whose direct evaluations are costly. In this paper, we tackle the problem of incorporating expert knowledge into BO, with the goal of further accelerating the optimization, which has received very little attention so far. We design a multi-task learning architecture for this task, with the goal of jointly eliciting the expert knowledge and minimizing the objective function. In particular, this allows for the expert knowledge to be transferred into the BO task. We introduce a specific architecture based on Siamese neural networks to handle the knowledge elicitation from pairwise queries. Experiments on various benchmark functions with both simulated and actual human experts show that the proposed method significantly speeds up BO even when the expert knowledge is biased compared to the objective function.

READ FULL TEXT
research
02/26/2020

Incorporating Expert Prior Knowledge into Experimental Design via Posterior Sampling

Scientific experiments are usually expensive due to complex experimental...
research
07/06/2020

Multi-Fidelity Bayesian Optimization via Deep Neural Networks

Bayesian optimization (BO) is a popular framework to optimize black-box ...
research
10/25/2022

Multi-Fidelity Bayesian Optimization with Unreliable Information Sources

Bayesian optimization (BO) is a powerful framework for optimizing black-...
research
07/09/2020

Resource Aware Multifidelity Active Learning for Efficient Optimization

Traditional methods for black box optimization require a considerable nu...
research
07/13/2022

Non-Myopic Multifidelity Bayesian Optimization

Bayesian optimization is a popular framework for the optimization of bla...
research
03/30/2021

High-Dimensional Bayesian Optimization with Multi-Task Learning for RocksDB

RocksDB is a general-purpose embedded key-value store used in multiple d...
research
08/22/2023

HypBO: Expert-Guided Chemist-in-the-Loop Bayesian Search for New Materials

Robotics and automation offer massive accelerations for solving intracta...

Please sign up or login with your details

Forgot password? Click here to reset