Discovering Evolutionary Stepping Stones through Behavior Domination

04/18/2017
by   Elliot Meyerson, et al.
0

Behavior domination is proposed as a tool for understanding and harnessing the power of evolutionary systems to discover and exploit useful stepping stones. Novelty search has shown promise in overcoming deception by collecting diverse stepping stones, and several algorithms have been proposed that combine novelty with a more traditional fitness measure to refocus search and help novelty search scale to more complex domains. However, combinations of novelty and fitness do not necessarily preserve the stepping stone discovery that novelty search affords. In several existing methods, competition between solutions can lead to an unintended loss of diversity. Behavior domination defines a class of algorithms that avoid this problem, while inheriting theoretical guarantees from multiobjective optimization. Several existing algorithms are shown to be in this class, and a new algorithm is introduced based on fast non-dominated sorting. Experimental results show that this algorithm outperforms existing approaches in domains that contain useful stepping stones, and its advantage is sustained with scale. The conclusion is that behavior domination can help illuminate the complex dynamics of behavior-driven search, and can thus lead to the design of more scalable and robust algorithms.

READ FULL TEXT
research
07/02/2014

Novelty Search in Competitive Coevolution

One of the main motivations for the use of competitive coevolution syste...
research
07/24/2022

A Parallel Novelty Search Metaheuristic Applied to a Wildfire Prediction System

Wildfires are a highly prevalent multi-causal environmental phenomenon. ...
research
07/06/2018

Quality Diversity Through Surprise

Quality diversity is a recent evolutionary computation paradigm which ma...
research
06/16/2023

On Evolvability and Behavior Landscapes in Neuroevolutionary Divergent Search

Evolvability refers to the ability of an individual genotype (solution) ...
research
06/27/2022

Emergence of Novelty in Evolutionary Algorithms

One of the main problems of evolutionary algorithms is the convergence o...
research
05/06/2022

Geodesics, Non-linearities and the Archive of Novelty Search

The Novelty Search (NS) algorithm was proposed more than a decade ago. H...
research
02/10/2020

Novelty Producing Synaptic Plasticity

A learning process with the plasticity property often requires reinforce...

Please sign up or login with your details

Forgot password? Click here to reset