Self-Adjusting Mutation Rates with Provably Optimal Success Rules

02/07/2019
by   Benjamin Doerr, et al.
0

The one-fifth success rule is one of the best-known and most widely accepted techniques to control the parameters of evolutionary algorithms. While it is often applied in the literal sense, a common interpretation sees the one-fifth success rule as a family of success-based updated rules that are determined by an update strength F and a success rate s. We analyze in this work how the performance of the (1+1) Evolutionary Algorithm (EA) on LeadingOnes depends on these two hyper-parameters. Our main result shows that the best performance is obtained for small update strengths F=1+o(1) and success rate 1/e. We also prove that the running time obtained by this parameter setting is asymptotically optimal among all dynamic choices of the mutation rate for the (1+1) EA. We show similar results for the resampling variant of the (1+1) EA, which enforces to flip at least one bit per iteration.

READ FULL TEXT
research
04/12/2021

Self-Adjusting Population Sizes for Non-Elitist Evolutionary Algorithms: Why Success Rates Matter

Recent theoretical studies have shown that self-adjusting mechanisms can...
research
04/13/2015

Optimal Parameter Choices Through Self-Adjustment: Applying the 1/5-th Rule in Discrete Settings

While evolutionary algorithms are known to be very successful for a broa...
research
04/07/2017

The (1+λ) Evolutionary Algorithm with Self-Adjusting Mutation Rate

We propose a new way to self-adjust the mutation rate in population-base...
research
04/17/2019

Offspring Population Size Matters when Comparing Evolutionary Algorithms with Self-Adjusting Mutation Rates

We analyze the performance of the 2-rate (1+λ) Evolutionary Algorithm (E...
research
06/19/2020

Hybridizing the 1/5-th Success Rule with Q-Learning for Controlling the Mutation Rate of an Evolutionary Algorithm

It is well known that evolutionary algorithms (EAs) achieve peak perform...
research
04/09/2019

Hyper-Parameter Tuning for the (1+(λ,λ)) GA

It is known that the (1+(λ,λ)) Genetic Algorithm (GA) with self-adjustin...

Please sign up or login with your details

Forgot password? Click here to reset