Covariance Matrix Adaptation MAP-Annealing

05/22/2022
by   Matthew C. Fontaine, et al.
0

Single-objective optimization algorithms search for the single highest-quality solution with respect to an objective. In contrast, quality diversity (QD) optimization algorithms, such as Covariance Matrix Adaptation MAP-Elites (CMA-ME), search for a collection of solutions that are both high-quality with respect to an objective and diverse with respect to specified measure functions. We propose a new quality diversity algorithm, Covariance Matrix Adaptation MAP-Annealing (CMA-MAE), which bridges the gap between single-objective optimization and QD optimization. We prove that CMA-MAE smoothly blends between the Covariance Matrix Adaptation Evolution Strategy (CMA-ES) single-objective optimizer and CMA-ME by gradually annealing a discount function with a scalar learning rate. We show that CMA-MAE has better performance than the current state-of-the-art QD algorithms on several benchmark domains and that its performance is empirically invariant to the archive resolution and robust to the discount function learning rate.

READ FULL TEXT

page 7

page 8

page 30

page 31

page 33

page 34

page 35

research
12/05/2019

Covariance Matrix Adaptation for the Rapid Illumination of Behavior Space

Quality Diversity (QD) algorithms like Novelty Search with Local Competi...
research
10/06/2022

Training Diverse High-Dimensional Controllers by Scaling Covariance Matrix Adaptation MAP-Annealing

Pre-training a diverse set of robot controllers in simulation has enable...
research
03/22/2022

A Unified Substrate for Body-Brain Co-evolution

The discovery of complex multicellular organism development took million...
research
06/10/2019

Exploration and Exploitation in Symbolic Regression using Quality-Diversity and Evolutionary Strategies Algorithms

By combining Genetic Programming, MAP-Elites and Covariance Matrix Adapt...
research
08/18/2023

A Principle for Global Optimization with Gradients

This work demonstrates the utility of gradients for the global optimizat...
research
04/14/2022

High-performance Evolutionary Algorithms for Online Neuron Control

Recently, optimization has become an emerging tool for neuroscientists t...

Please sign up or login with your details

Forgot password? Click here to reset