Biophysical Cybernetics of Directed Evolution and Eco-evolutionary Dynamics

05/05/2023
by   Bryce Allen Bagley, et al.
0

Many major questions in the theory of evolutionary dynamics can in a meaningful sense be mapped to analyses of stochastic trajectories in game theoretic contexts. Often the approach is to analyze small numbers of distinct populations and/or to assume dynamics occur within a regime of population sizes large enough that deterministic trajectories are an excellent approximation of reality. The addition of ecological factors, termed "eco-evolutionary dynamics", further complicates the dynamics and results in many problems which are intractable or impractically messy for current theoretical methods. However, an analogous but underexplored approach is to analyze these systems with an eye primarily towards uncertainty in the models themselves. In the language of researchers in Reinforcement Learning and adjacent fields, a Partially Observable Markov Process. Here we introduce a duality which maps the complexity of accounting for both ecology and individual genotypic/phenotypic types onto a problem of accounting solely for underlying information-theoretic computations rather than drawing physical boundaries which do not change the computations. Armed with this equivalence between computation and the relevant biophysics, which we term Taak-duality, we attack the problem of "directed evolution" in the form of a Partially Observable Markov Decision Process. This provides a tractable case of studying eco-evolutionary trajectories of a highly general type, and of analyzing questions of potential limits on the efficiency of evolution in the directed case.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/02/2022

Periodic orbits in evolutionary game dynamics: An information-theoretic perspective

Even though existence of non-convergent evolution of the states of popul...
research
11/15/2021

The Partially Observable History Process

We introduce the partially observable history process (POHP) formalism f...
research
11/05/2019

A Note on Quantum Markov Models

The study of Markov models is central to control theory and machine lear...
research
04/07/2021

Evolutionary rates of information gain and decay in fluctuating environments

In this paper, we wish to investigate the dynamics of information transf...
research
09/15/2021

Evolutionary Reinforcement Learning Dynamics with Irreducible Environmental Uncertainty

In this work we derive and present evolutionary reinforcement learning d...
research
05/30/2021

Shaped Policy Search for Evolutionary Strategies using Waypoints

In this paper, we try to improve exploration in Blackbox methods, partic...

Please sign up or login with your details

Forgot password? Click here to reset