The dynamical regime and its importance for evolvability, task performance and generalization

by   Jan Prosi, et al.

It has long been hypothesized that operating close to the critical state is beneficial for natural and artificial systems. We test this hypothesis by evolving foraging agents controlled by neural networks that can change the system's dynamical regime throughout evolution. Surprisingly, we find that all populations, regardless of their initial regime, evolve to be subcritical in simple tasks and even strongly subcritical populations can reach comparable performance. We hypothesize that the moderately subcritical regime combines the benefits of generalizability and adaptability brought by closeness to criticality with the stability of the dynamics characteristic for subcritical systems. By a resilience analysis, we find that initially critical agents maintain their fitness level even under environmental changes and degrade slowly with increasing perturbation strength. On the other hand, subcritical agents originally evolved to the same fitness, were often rendered utterly inadequate and degraded faster. We conclude that although the subcritical regime is preferable for a simple task, the optimal deviation from criticality depends on the task difficulty: for harder tasks, agents evolve closer to criticality. Furthermore, subcritical populations cannot find the path to decrease their distance to criticality. In summary, our study suggests that initializing models near criticality is important to find an optimal and flexible solution.


page 1

page 2

page 3

page 4


When to be critical? Performance and evolvability in different regimes of neural Ising agents

It has long been hypothesized that operating close to the critical state...

Balancing Selection Pressures, Multiple Objectives, and Neural Modularity to Coevolve Cooperative Agent Behavior

Previous research using evolutionary computation in Multi-Agent Systems ...

Inferring Fitness in Finite Populations with Moran-like dynamics

Biological fitness is not an observable quantity and must be inferred fr...

Dynamics of niche construction in adaptable populations evolving in diverse environments

In both natural and artificial studies, evolution is often seen as synon...

Moderate Environmental Variation Promotes Adaptation in Artificial Evolution

In this paper we analyze the role of environmental variations in the evo...

Emergent Criticality Through Adaptive Information Processing in Boolean Networks

We study information processing in populations of Boolean networks with ...

The downside of heterogeneity: How established relations counteract systemic adaptivity in tasks assignments

We study the lock-in effect in a network of task assignments. Agents hav...

Please sign up or login with your details

Forgot password? Click here to reset