Ensemble Feature Extraction for Multi-Container Quality-Diversity Algorithms

05/03/2021
by   Leo Cazenille, et al.
0

Quality-Diversity algorithms search for large collections of diverse and high-performing solutions, rather than just for a single solution like typical optimisation methods. They are specially adapted for multi-modal problems that can be solved in many different ways, such as complex reinforcement learning or robotics tasks. However, these approaches are highly dependent on the choice of feature descriptors (FDs) quantifying the similarity in behaviour of the solutions. While FDs usually needs to be hand-designed, recent studies have proposed ways to define them automatically by using feature extraction techniques, such as PCA or Auto-Encoders, to learn a representation of the problem from previously explored solutions. Here, we extend these approaches to more complex problems which cannot be efficiently explored by relying only on a single representation but require instead a set of diverse and complementary representations. We describe MC-AURORA, a Quality-Diversity approach that optimises simultaneously several collections of solutions, each with a different set of FDs, which are, in turn, defined automatically by an ensemble of modular auto-encoders. We show that this approach produces solutions that are more diverse than those produced by single-representation approaches.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 6

07/10/2020

Multi-Emitter MAP-Elites: Improving quality, diversity and convergence speed with heterogeneous sets of emitters

Quality-Diversity (QD) optimisation is a new family of learning algorith...
05/10/2021

An Analysis of Phenotypic Diversity in Multi-Solution Optimization

More and more, optimization methods are used to find diverse solution se...
03/19/2021

Quality Evolvability ES: Evolving Individuals With a Distribution of Well Performing and Diverse Offspring

One of the most important lessons from the success of deep learning is t...
06/25/2020

Fast and stable MAP-Elites in noisy domains using deep grids

Quality-Diversity optimisation algorithms enable the evolution of collec...
04/08/2019

Large Margin Multi-modal Multi-task Feature Extraction for Image Classification

The features used in many image analysis-based applications are frequent...
04/21/2022

Relevance-guided Unsupervised Discovery of Abilities with Quality-Diversity Algorithms

Quality-Diversity algorithms provide efficient mechanisms to generate la...
07/25/2018

Prototype Discovery using Quality-Diversity

An iterative computer-aided ideation procedure is introduced, building o...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.