Preferential Bayesian optimisation with Skew Gaussian Processes

08/15/2020
by   Alessio Benavoli, et al.
0

Bayesian optimisation (BO) is a very effective approach for sequential black-box optimization where direct queries of the objective function are expensive. However, there are cases where the objective function can only be accessed via preference judgments, such as "this is better than that" between two candidate solutions (like in A/B tests or recommender systems). The state-of-the-art approach to Preferential Bayesian Optimization (PBO) uses a Gaussian process to model the preference function and a Bernoulli likelihood to model the observed pairwise comparisons. Laplace's method is then employed to compute posterior inferences and, in particular, to build an appropriate acquisition function. In this paper, we prove that the true posterior distribution of the preference function is a Skew Gaussian Process (SkewGP), with highly skewed pairwise marginals and, thus, show that Laplace's method usually provides a very poor approximation. We then derive an efficient method to compute the exact SkewGP posterior and use it as surrogate model for PBO employing standard acquisition functions (Upper Credible Bound, etc.). We illustrate the benefits of our exact PBO-SkewGP in a variety of experiments, by showing that it consistently outperforms PBO based on Laplace's approximation both in terms of convergence speed and computational time. We also show that our framework can be extended to deal with mixed preferential-categorical BO, typical for instance in smart manufacturing, where binary judgments (valid or non-valid) together with preference judgments are available.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

page 3

page 4

04/12/2017

Preferential Bayesian Optimization

Bayesian optimization (BO) has emerged during the last few years as an e...
03/09/2020

Composition of kernel and acquisition functions for High Dimensional Bayesian Optimization

Bayesian Optimization has become the reference method for the global opt...
09/22/2021

A Robust Asymmetric Kernel Function for Bayesian Optimization, with Application to Image Defect Detection in Manufacturing Systems

Some response surface functions in complex engineering systems are usual...
10/27/2014

Heteroscedastic Treed Bayesian Optimisation

Optimising black-box functions is important in many disciplines, such as...
10/18/2021

Efficient Exploration in Binary and Preferential Bayesian Optimization

Bayesian optimization (BO) is an effective approach to optimize expensiv...
01/03/2018

A Comprehensive Bayesian Treatment of the Universal Kriging model with Matérn correlation kernels

The Gibbs reference posterior distribution provides an objective full-Ba...
01/03/2018

A Comprehensive Bayesian Treatment of the Universal Kriging parameters with Matérn correlation kernels

The Gibbs reference posterior distribution provides an objective full-Ba...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.