Efficient Transfer Bayesian Optimization with Auxiliary Information

09/17/2019
by   Tomoharu Iwata, et al.
4

We propose an efficient transfer Bayesian optimization method, which finds the maximum of an expensive-to-evaluate black-box function by using data on related optimization tasks. Our method uses auxiliary information that represents the task characteristics to effectively transfer knowledge for estimating a distribution over target functions. In particular, we use a Gaussian process, in which the mean and covariance functions are modeled with neural networks that simultaneously take both the auxiliary information and feature vectors as input. With a neural network mean function, we can estimate the target function even without evaluations. By using the neural network covariance function, we can extract nonlinear correlation among feature vectors that are shared across related tasks. Our Gaussian process-based formulation not only enables an analytic calculation of the posterior distribution but also swiftly adapts the target function to observations. Our method is also advantageous because the computational costs scale linearly with the number of source tasks. Through experiments using a synthetic dataset and datasets for finding the optimal pedestrian traffic regulations and optimal machine learning algorithms, we demonstrate that our method identifies the optimal points with fewer target function evaluations than existing methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 6

page 7

page 8

research
03/03/2023

Neural-BO: A Black-box Optimization Algorithm using Deep Neural Networks

Bayesian Optimization (BO) is an effective approach for global optimizat...
research
03/21/2023

Bayesian Optimization for Function Compositions with Applications to Dynamic Pricing

Bayesian Optimization (BO) is used to find the global optima of black bo...
research
04/23/2021

Scalable and Flexible Deep Bayesian Optimization with Auxiliary Information for Scientific Problems

Bayesian optimization (BO) is a popular paradigm for global optimization...
research
09/22/2021

A Robust Asymmetric Kernel Function for Bayesian Optimization, with Application to Image Defect Detection in Manufacturing Systems

Some response surface functions in complex engineering systems are usual...
research
12/01/2019

Bayesian Optimization Approach for Analog Circuit Synthesis Using Neural Network

Bayesian optimization with Gaussian process as surrogate model has been ...
research
01/04/2021

Gaussian Function On Response Surface Estimation

We propose a new framework for 2-D interpreting (features and samples) b...
research
06/17/2019

Bayesian Optimization with Binary Auxiliary Information

This paper presents novel mixed-type Bayesian optimization (BO) algorith...

Please sign up or login with your details

Forgot password? Click here to reset