BOP-Elites, a Bayesian Optimisation algorithm for Quality-Diversity search

05/08/2020
by   Paul Kent, et al.
0

Quality Diversity (QD) algorithms such as MAP-Elites are a class of optimisation techniques that attempt to find a set of high-performing points from an objective function while enforcing behavioural diversity of the points over one or more interpretable, user chosen, feature functions. In this paper we propose the Bayesian Optimisation of Elites (BOP-Elites) algorithm that uses techniques from Bayesian Optimisation to explicitly model both quality and diversity with Gaussian Processes. By considering user defined regions of the feature space as 'niches' our task is to find the optimal solution in each niche. We propose a novel acquisition function to intelligently choose new points that provide the highest expected improvement to the ensemble problem of identifying the best solution in every niche. In this way each function evaluation enriches our modelling and provides insight to the whole problem, naturally balancing exploration and exploitation of the search space. The resulting algorithm is very effective in identifying the parts of the search space that belong to a niche in feature space, and finding the optimal solution in each niche. It is also significantly more sample efficient than simpler benchmark approaches. BOP-Elites goes further than existing QD algorithms by quantifying the uncertainty around our predictions and offering additional illumination of the search space through surrogate models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/30/2023

Runtime Analysis of Quality Diversity Algorithms

Quality diversity (QD) is a branch of evolutionary computation that gain...
research
05/31/2020

Bayesian Optimisation vs. Input Uncertainty Reduction

Simulators often require calibration inputs estimated from real world da...
research
03/27/2020

Incorporating Expert Prior in Bayesian Optimisation via Space Warping

Bayesian optimisation is a well-known sample-efficient method for the op...
research
12/08/2020

Quality-Diversity Optimization: a novel branch of stochastic optimization

Traditional optimization algorithms search for a single global optimum t...
research
07/23/2019

Comparing reliability of grid-based Quality-Diversity algorithms using artificial landscapes

Quality-Diversity (QD) algorithms are a recent type of optimisation meth...
research
07/22/2016

Optimal resampling for the noisy OneMax problem

The OneMax problem is a standard benchmark optimisation problem for a bi...
research
01/24/2023

Inducing Point Allocation for Sparse Gaussian Processes in High-Throughput Bayesian Optimisation

Sparse Gaussian Processes are a key component of high-throughput Bayesia...

Please sign up or login with your details

Forgot password? Click here to reset