Cumulative Step-size Adaptation on Linear Functions

12/01/2012
by   Alexandre Chotard, et al.
0

The CSA-ES is an Evolution Strategy with Cumulative Step size Adaptation, where the step size is adapted measuring the length of a so-called cumulative path. The cumulative path is a combination of the previous steps realized by the algorithm, where the importance of each step decreases with time. This article studies the CSA-ES on composites of strictly increasing functions with affine linear functions through the investigation of its underlying Markov chains. Rigorous results on the change and the variation of the step size are derived with and without cumulation. The step-size diverges geometrically fast in most cases. Furthermore, the influence of the cumulation parameter is studied.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/11/2014

Markov Chain Analysis of Evolution Strategies on a Linear Constraint Optimization Problem

This paper analyses a (1,λ)-Evolution Strategy, a randomised comparison-...
research
06/24/2022

Reinforcement learning based adaptive metaheuristics

Parameter adaptation, that is the capability to automatically adjust an ...
research
06/18/2014

A Generalized Markov-Chain Modelling Approach to (1,λ)-ES Linear Optimization: Technical Report

Several recent publications investigated Markov-chain modelling of linea...
research
01/23/2019

Analysis of the (μ/μ_I,λ)-CSA-ES with Repair by Projection Applied to a Conically Constrained Problem

Theoretical analyses of evolution strategies are indispensable for gaini...
research
07/01/2012

Alternative Restart Strategies for CMA-ES

This paper focuses on the restart strategy of CMA-ES on multi-modal func...
research
07/21/2023

Run Time Bounds for Integer-Valued OneMax Functions

While most theoretical run time analyses of discrete randomized search h...
research
02/01/2021

Painless step size adaptation for SGD

Convergence and generalization are two crucial aspects of performance in...

Please sign up or login with your details

Forgot password? Click here to reset