Discovering Unsupervised Behaviours from Full-State Trajectories

11/22/2022
by   Luca Grillotti, et al.
0

Improving open-ended learning capabilities is a promising approach to enable robots to face the unbounded complexity of the real-world. Among existing methods, the ability of Quality-Diversity algorithms to generate large collections of diverse and high-performing skills is instrumental in this context. However, most of those algorithms rely on a hand-coded behavioural descriptor to characterise the diversity, hence requiring prior knowledge about the considered tasks. In this work, we propose an additional analysis of Autonomous Robots Realising their Abilities; a Quality-Diversity algorithm that autonomously finds behavioural characterisations. We evaluate this approach on a simulated robotic environment, where the robot has to autonomously discover its abilities from its full-state trajectories. All algorithms were applied to three tasks: navigation, moving forward with a high velocity, and performing half-rolls. The experimental results show that the algorithm under study discovers autonomously collections of solutions that are diverse with respect to all tasks. More specifically, the analysed approach autonomously finds policies that make the robot move to diverse positions, but also utilise its legs in diverse ways, and even perform half-rolls.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/21/2022

Relevance-guided Unsupervised Discovery of Abilities with Quality-Diversity Algorithms

Quality-Diversity algorithms provide efficient mechanisms to generate la...
research
06/10/2021

Unsupervised Behaviour Discovery with Quality-Diversity Optimisation

Quality-Diversity algorithms refer to a class of evolutionary algorithms...
research
08/25/2023

Integrating LLMs and Decision Transformers for Language Grounded Generative Quality-Diversity

Quality-Diversity is a branch of stochastic optimization that is often a...
research
05/28/2019

Autonomous skill discovery with Quality-Diversity and Unsupervised Descriptors

Quality-Diversity optimization is a new family of optimization algorithm...
research
10/18/2022

Online Damage Recovery for Physical Robots with Hierarchical Quality-Diversity

In real-world environments, robots need to be resilient to damages and r...
research
03/19/2021

Quality Evolvability ES: Evolving Individuals With a Distribution of Well Performing and Diverse Offspring

One of the most important lessons from the success of deep learning is t...
research
06/25/2020

Fast and stable MAP-Elites in noisy domains using deep grids

Quality-Diversity optimisation algorithms enable the evolution of collec...

Please sign up or login with your details

Forgot password? Click here to reset