Bayesian Optimisation over Multiple Continuous and Categorical Inputs

06/20/2019
by   Binxin Ru, et al.
5

Efficient optimisation of black-box problems that comprise both continuous and categorical inputs is important, yet poses significant challenges. We propose a new approach, Continuous and Categorical Bayesian Optimisation (CoCaBO), which combines the strengths of multi-armed bandits and Bayesian optimisation to select values for both categorical and continuous inputs. We model this mixed-type space using a Gaussian Process kernel, designed to allow sharing of information across multiple categorical variables, each with multiple possible values; this allows CoCaBO to leverage all available data efficiently. We extend our method to the batch setting and propose an efficient selection procedure that dynamically balances exploration and exploitation whilst encouraging batch diversity. We demonstrate empirically that our method outperforms existing approaches on both synthetic and real-world optimisation tasks with continuous and categorical inputs.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/10/2022

Bayesian Optimisation for Mixed-Variable Inputs using Value Proposals

Many real-world optimisation problems are defined over both categorical ...
research
02/14/2021

Think Global and Act Local: Bayesian Optimisation over High-Dimensional Categorical and Mixed Search Spaces

High-dimensional black-box optimisation remains an important yet notorio...
research
06/27/2022

A penalisation method for batch multi-objective Bayesian optimisation with application in heat exchanger design

We present HIghly Parallelisable Pareto Optimisation (HIPPO) – a batch a...
research
10/06/2020

Gaussian Process Models with Low-Rank Correlation Matrices for Both Continuous and Categorical Inputs

We introduce a method that uses low-rank approximations of cross-correla...
research
01/29/2023

Contextual Causal Bayesian Optimisation

Causal Bayesian optimisation (CaBO) combines causality with Bayesian opt...
research
11/28/2019

Bayesian Optimization for Categorical and Category-Specific Continuous Inputs

Many real-world functions are defined over both categorical and category...
research
02/21/2019

Bayesian optimisation under uncertain inputs

Bayesian optimisation (BO) has been a successful approach to optimise fu...

Please sign up or login with your details

Forgot password? Click here to reset