Embodied Intelligence via Learning and Evolution

02/03/2021
by   Agrim Gupta, et al.
10

The intertwined processes of learning and evolution in complex environmental niches have resulted in a remarkable diversity of morphological forms. Moreover, many aspects of animal intelligence are deeply embodied in these evolved morphologies. However, the principles governing relations between environmental complexity, evolved morphology, and the learnability of intelligent control, remain elusive, partially due to the substantial challenge of performing large-scale in silico experiments on evolution and learning. We introduce Deep Evolutionary Reinforcement Learning (DERL): a novel computational framework which can evolve diverse agent morphologies to learn challenging locomotion and manipulation tasks in complex environments using only low level egocentric sensory information. Leveraging DERL we demonstrate several relations between environmental complexity, morphological intelligence and the learnability of control. First, environmental complexity fosters the evolution of morphological intelligence as quantified by the ability of a morphology to facilitate the learning of novel tasks. Second, evolution rapidly selects morphologies that learn faster, thereby enabling behaviors learned late in the lifetime of early ancestors to be expressed early in the lifetime of their descendants. In agents that learn and evolve in complex environments, this result constitutes the first demonstration of a long-conjectured morphological Baldwin effect. Third, our experiments suggest a mechanistic basis for both the Baldwin effect and the emergence of morphological intelligence through the evolution of morphologies that are more physically stable and energy efficient, and can therefore facilitate learning and control.

READ FULL TEXT

page 3

page 5

page 10

research
03/25/2019

Towards a framework for the evolution of artificial general intelligence

In this work, a novel framework for the emergence of general intelligenc...
research
11/16/2021

The role of attraction-repulsion dynamics in simulating the emergence of inflectional class systems

Dynamic models of paradigm change can elucidate how the simplest of proc...
research
10/27/2015

Increasing Behavioral Complexity for Evolved Virtual Creatures with the ESP Method

Since their introduction in 1994 (Sims), evolved virtual creatures (EVCs...
research
11/17/2017

Evolving soft locomotion in aquatic and terrestrial environments: effects of material properties and environmental transitions

Designing soft robots poses considerable challenges: automated design ap...
research
09/28/2022

DMAP: a Distributed Morphological Attention Policy for Learning to Locomote with a Changing Body

Biological and artificial agents need to deal with constant changes in t...
research
05/21/2022

Co-design of Embodied Neural Intelligence via Constrained Evolution

We introduce a novel co-design method for autonomous moving agents' shap...
research
06/12/2020

Recursion and evolution: Part II

We examine the question of whether it is possible for a diagonalizing sy...

Please sign up or login with your details

Forgot password? Click here to reset