A Generalized Markov-Chain Modelling Approach to (1,λ)-ES Linear Optimization: Technical Report

06/18/2014
by   Alexandre Chotard, et al.
0

Several recent publications investigated Markov-chain modelling of linear optimization by a (1,λ)-ES, considering both unconstrained and linearly constrained optimization, and both constant and varying step size. All of them assume normality of the involved random steps, and while this is consistent with a black-box scenario, information on the function to be optimized (e.g. separability) may be exploited by the use of another distribution. The objective of our contribution is to complement previous studies realized with normal steps, and to give sufficient conditions on the distribution of the random steps for the success of a constant step-size (1,λ)-ES on the simple problem of a linear function with a linear constraint. The decomposition of a multidimensional distribution into its marginals and the copula combining them is applied to the new distributional assumptions, particular attention being paid to distributions with Archimedean copulas.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/11/2014

Markov Chain Analysis of Evolution Strategies on a Linear Constraint Optimization Problem

This paper analyses a (1,λ)-Evolution Strategy, a randomised comparison-...
research
12/01/2012

Cumulative Step-size Adaptation on Linear Functions

The CSA-ES is an Evolution Strategy with Cumulative Step size Adaptation...
research
09/12/2017

Linear Stochastic Approximation: Constant Step-Size and Iterate Averaging

We consider d-dimensional linear stochastic approximation algorithms (LS...
research
11/12/2014

On TD(0) with function approximation: Concentration bounds and a centered variant with exponential convergence

We provide non-asymptotic bounds for the well-known temporal difference ...
research
06/08/2020

Random derangements and the Ewens Sampling Formula

We study derangements of {1,2,...,n} under the Ewens distribution with p...
research
01/06/2022

On the geometric convergence for MALA under verifiable conditions

While the Metropolis Adjusted Langevin Algorithm (MALA) is a popular and...
research
02/21/2019

Online Sampling from Log-Concave Distributions

Given a sequence of convex functions f_0, f_1, ..., f_T, we study the pr...

Please sign up or login with your details

Forgot password? Click here to reset