Preferential Batch Bayesian Optimization

03/25/2020
by   Eero Siivola, et al.
14

Most research in Bayesian optimization (BO) has focused on direct feedback scenarios, where one has access to exact, or perturbed, values of some expensive-to-evaluate objective. This direction has been mainly driven by the use of BO in machine learning hyper-parameter configuration problems. However, in domains such as modelling human preferences, A/B tests or recommender systems, there is a need of methods that are able to replace direct feedback with preferential feedback, obtained via rankings or pairwise comparisons. In this work, we present Preferential Batch Bayesian Optimization (PBBO), a new framework that allows to find the optimum of a latent function of interest, given any type of parallel preferential feedback for a group of two or more points. We do so by using a Gaussian process model with a likelihood specially designed to enable parallel and efficient data collection mechanisms, which are key in modern machine learning. We show how the acquisitions developed under this framework generalize and augment previous approaches in Bayesian optimization, expanding the use of these techniques to a wider range of domains. An extensive simulation study shows the benefits of this approach, both with simulated functions and four real data sets.

READ FULL TEXT
research
04/12/2017

Preferential Bayesian Optimization

Bayesian optimization (BO) has emerged during the last few years as an e...
research
07/02/2020

BOSH: Bayesian Optimization by Sampling Hierarchically

Deployments of Bayesian Optimization (BO) for functions with stochastic ...
research
11/23/2015

Parallel Predictive Entropy Search for Batch Global Optimization of Expensive Objective Functions

We develop parallel predictive entropy search (PPES), a novel algorithm ...
research
05/24/2022

Advanced Manufacturing Configuration by Sample-efficient Batch Bayesian Optimization

We propose a framework for the configuration and operation of expensive-...
research
05/29/2015

Batch Bayesian Optimization via Local Penalization

The popularity of Bayesian optimization methods for efficient exploratio...
research
02/26/2021

Batch Bayesian Optimization on Permutations using Acquisition Weighted Kernels

In this work we propose a batch Bayesian optimization method for combina...
research
06/10/2019

Sampling Humans for Optimizing Preferences in Coloring Artwork

Many circumstances of practical importance have performance or success m...

Please sign up or login with your details

Forgot password? Click here to reset