Morpho-evolution with learning using a controller archive as an inheritance mechanism

04/09/2021
by   Léni K. Le Goff, et al.
6

In evolutionary robotics, several approaches have been shown to be capable of the joint optimisation of body-plans and controllers by either using only evolution or combining evolution and learning. When working in rich morphological spaces, it is common for offspring to have body-plans that are very different from either of their parents, which can cause difficulties with respect to inheriting a suitable controller. To address this, we propose a framework that combines an evolutionary algorithm to generate body-plans and a learning algorithm to optimise the parameters of a neural controller where the topology of this controller is created once the body-plan of each offspring body-plan is generated. The key novelty of the approach is to add an external archive for storing learned controllers that map to explicit `types' of robots (where this is defined with respect the features of the body-plan). By inheriting an appropriate controller from the archive rather than learning from a randomly initialised one, we show that both the speed and magnitude of learning increases over time when compared to an approach that starts from scratch, using three different test-beds. The framework also provides new insights into the complex interactions between evolution and learning, and the role of morphological intelligence in robot design.

READ FULL TEXT

page 2

page 7

page 11

research
06/12/2023

Modular Controllers Facilitate the Co-Optimization of Morphology and Control in Soft Robots

Soft robotics is a rapidly growing area of robotics research that would ...
research
06/22/2017

A Minimal Developmental Model Can Increase Evolvability in Soft Robots

Different subsystems of organisms adapt over many time scales, such as r...
research
11/20/2017

How morphological development can guide evolution

Organisms result from multiple adaptive processes occurring and interact...
research
06/19/2017

Scalable Co-Optimization of Morphology and Control in Embodied Machines

Evolution sculpts both the body plans and nervous systems of agents toge...
research
03/22/2016

Adaptive Parameter Selection in Evolutionary Algorithms by Reinforcement Learning with Dynamic Discretization of Parameter Range

Online parameter controllers for evolutionary algorithms adjust values o...
research
09/25/2016

Sooner than Expected: Hitting the Wall of Complexity in Evolution

In evolutionary robotics an encoding of the control software, which maps...
research
04/06/2018

Interoceptive robustness through environment-mediated morphological development

Typically, AI researchers and roboticists try to realize intelligent beh...

Please sign up or login with your details

Forgot password? Click here to reset