A Reinforcement Learning Perspective on the Optimal Control of Mutation Probabilities for the (1+1) Evolutionary Algorithm: First Results on the OneMax Problem

05/09/2019
by   Luca Mossina, et al.
0

We study how Reinforcement Learning can be employed to optimally control parameters in evolutionary algorithms. We control the mutation probability of a (1+1) evolutionary algorithm on the OneMax function. This problem is modeled as a Markov Decision Process and solved with Value Iteration via the known transition probabilities. It is then solved via Q-Learning, a Reinforcement Learning algorithm, where the exact transition probabilities are not needed. This approach also allows previous expert or empirical knowledge to be included into learning. It opens new perspectives, both formally and computationally, for the problem of parameter control in optimization.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/09/2011

KL-learning: Online solution of Kullback-Leibler control problems

We introduce a stochastic approximation method for the solution of an er...
research
08/05/2016

The Evolutionary Process of Image Transition in Conjunction with Box and Strip Mutation

Evolutionary algorithms have been used in many ways to generate digital ...
research
02/06/2021

Learning adaptive differential evolution algorithm from optimization experiences by policy gradient

Differential evolution is one of the most prestigious population-based s...
research
02/09/2021

Optimal Static Mutation Strength Distributions for the (1+λ) Evolutionary Algorithm on OneMax

Most evolutionary algorithms have parameters, which allow a great flexib...
research
04/21/2016

Evolutionary Image Transition Based on Theoretical Insights of Random Processes

Evolutionary algorithms have been widely studied from a theoretical pers...
research
04/19/2023

Integrated Ray-Tracing and Coverage Planning Control using Reinforcement Learning

In this work we propose a coverage planning control approach which allow...
research
02/25/2022

Reachability analysis in stochastic directed graphs by reinforcement learning

We characterize the reachability probabilities in stochastic directed gr...

Please sign up or login with your details

Forgot password? Click here to reset