Quality-Diversity Optimization: a novel branch of stochastic optimization

Traditional optimization algorithms search for a single global optimum that maximizes (or minimizes) the objective function. Multimodal optimization algorithms search for the highest peaks in the search space that can be more than one. Quality-Diversity algorithms are a recent addition to the evolutionary computation toolbox that do not only search for a single set of local optima, but instead try to illuminate the search space. In effect, they provide a holistic view of how high-performing solutions are distributed throughout a search space. The main differences with multimodal optimization algorithms are that (1) Quality-Diversity typically works in the behavioral space (or feature space), and not in the genotypic (or parameter) space, and (2) Quality-Diversity attempts to fill the whole behavior space, even if the niche is not a peak in the fitness landscape. In this chapter, we provide a gentle introduction to Quality-Diversity optimization, discuss the main representative algorithms, and the main current topics under consideration in the community. Throughout the chapter, we also discuss several successful applications of Quality-Diversity algorithms, including deep learning, robotics, and reinforcement learning.

READ FULL TEXT
research
08/05/2020

Quality and Diversity in Evolutionary Modular Robotics

In Evolutionary Robotics a population of solutions is evolved to optimiz...
research
06/10/2014

Maximizing Diversity for Multimodal Optimization

Most multimodal optimization algorithms use the so called niching method...
research
05/06/2022

Towards QD-suite: developing a set of benchmarks for Quality-Diversity algorithms

While the field of Quality-Diversity (QD) has grown into a distinct bran...
research
03/09/2020

Quality Diversity for Multi-task Optimization

Quality Diversity (QD) algorithms are a recent family of optimization al...
research
05/12/2017

Quality and Diversity Optimization: A Unifying Modular Framework

The optimization of functions to find the best solution according to one...
research
05/08/2020

BOP-Elites, a Bayesian Optimisation algorithm for Quality-Diversity search

Quality Diversity (QD) algorithms such as MAP-Elites are a class of opti...
research
05/30/2023

Runtime Analysis of Quality Diversity Algorithms

Quality diversity (QD) is a branch of evolutionary computation that gain...

Please sign up or login with your details

Forgot password? Click here to reset