Competitive Coevolution through Evolutionary Complexification

06/30/2011
by   R. Miikkulainen, et al.
0

Two major goals in machine learning are the discovery and improvement of solutions to complex problems. In this paper, we argue that complexification, i.e. the incremental elaboration of solutions through adding new structure, achieves both these goals. We demonstrate the power of complexification through the NeuroEvolution of Augmenting Topologies (NEAT) method, which evolves increasingly complex neural network architectures. NEAT is applied to an open-ended coevolutionary robot duel domain where robot controllers compete head to head. Because the robot duel domain supports a wide range of strategies, and because coevolution benefits from an escalating arms race, it serves as a suitable testbed for studying complexification. When compared to the evolution of networks with fixed structure, complexifying evolution discovers significantly more sophisticated strategies. The results suggest that in order to discover and improve complex solutions, evolution, and search in general, should be allowed to complexify as well as optimize.

READ FULL TEXT

page 3

page 20

page 23

research
05/15/2020

Improving Neuroevolution Using Island Extinction and Repopulation

Neuroevolution commonly uses speciation strategies to better explore the...
research
04/22/2020

Differential evolution outside the box

This paper investigates how often the popular configurations of Differen...
research
10/29/2020

A Framework for Learning Predator-prey Agents from Simulation to Real World

In this paper, we propose an evolutionary predatorprey robot system whic...
research
10/01/2021

Guiding Evolutionary Strategies by Differentiable Robot Simulators

In recent years, Evolutionary Strategies were actively explored in robot...
research
09/18/2012

Evolution and the structure of learning agents

This paper presents the thesis that all learning agents of finite inform...
research
09/26/2017

Embodied Evolution in Collective Robotics: A Review

This paper provides an overview of evolutionary robotics techniques appl...
research
08/08/2023

Asynchronous Evolution of Deep Neural Network Architectures

Many evolutionary algorithms (EAs) take advantage of parallel evaluation...

Please sign up or login with your details

Forgot password? Click here to reset