Unsupervised Behaviour Discovery with Quality-Diversity Optimisation

06/10/2021
by   Luca Grillotti, et al.
0

Quality-Diversity algorithms refer to a class of evolutionary algorithms designed to find a collection of diverse and high-performing solutions to a given problem. In robotics, such algorithms can be used for generating a collection of controllers covering most of the possible behaviours of a robot. To do so, these algorithms associate a behavioural descriptor to each of these behaviours. Each behavioural descriptor is used for estimating the novelty of one behaviour compared to the others. In most existing algorithms, the behavioural descriptor needs to be hand-coded, thus requiring prior knowledge about the task to solve. In this paper, we introduce: Autonomous Robots Realising their Abilities, an algorithm that uses a dimensionality reduction technique to automatically learn behavioural descriptors based on raw sensory data. The performance of this algorithm is assessed on three robotic tasks in simulation. The experimental results show that it performs similarly to traditional hand-coded approaches without the requirement to provide any hand-coded behavioural descriptor. In the collection of diverse and high-performing solutions, it also manages to find behaviours that are novel with respect to more features than its hand-coded baselines. Finally, we introduce a variant of the algorithm which is robust to the dimensionality of the behavioural descriptor space.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 9

05/28/2019

Autonomous skill discovery with Quality-Diversity and Unsupervised Descriptors

Quality-Diversity optimization is a new family of optimization algorithm...
03/04/2020

QED: using Quality-Environment-Diversity to evolve resilient robot swarms

In swarm robotics, any of the robots in a swarm may be affected by diffe...
09/08/2021

Quality-Diversity Meta-Evolution: customising behaviour spaces to a meta-objective

Quality-Diversity (QD) algorithms evolve behaviourally diverse and high-...
08/11/2021

Computing Diverse Sets of High Quality TSP Tours by EAX-Based Evolutionary Diversity Optimisation

Evolutionary algorithms based on edge assembly crossover (EAX) constitut...
03/19/2021

Quality Evolvability ES: Evolving Individuals With a Distribution of Well Performing and Diverse Offspring

One of the most important lessons from the success of deep learning is t...
07/25/2018

Prototype Discovery using Quality-Diversity

An iterative computer-aided ideation procedure is introduced, building o...
05/03/2021

Ensemble Feature Extraction for Multi-Container Quality-Diversity Algorithms

Quality-Diversity algorithms search for large collections of diverse and...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.