Non-Stationary Stochastic Global Optimization Algorithms

10/11/2020
by   Jonatan Gomez, et al.
17

Gomez proposes a formal and systematic approach for characterizing stochastic global optimization algorithms. Using it, Gomez formalizes algorithms with a fixed next-population stochastic method, i.e., algorithms defined as stationary Markov processes. These are the cases of standard versions of hill-climbing, parallel hill-climbing, generational genetic, steady-state genetic, and differential evolution algorithms. This paper continues such a systematic formal approach. First, we generalize the sufficient conditions convergence lemma from stationary to non-stationary Markov processes. Second, we develop Markov kernels for some selection schemes. Finally, we formalize both simulated-annealing and evolutionary-strategies using the systematic formal approach.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/07/2017

Stochastic Global Optimization Algorithms: A Systematic Formal Approach

As we know, some global optimization problems cannot be solved using ana...
research
09/18/2018

Non-Stationary Covariance Estimation using the Stochastic Score Approximation for Large Spatial Data

We introduce computational methods that allow for effective estimation o...
research
09/28/2021

Simulation of non-stationary and non-Gaussian random processes by 3rd-order Spectral Representation Method: Theory and POD implementation

This paper introduces the 3^rd-order Spectral Representation Method for ...
research
05/27/2020

Genetic optimization algorithms applied toward mission computability models

Genetic algorithms are modeled after the biological evolutionary process...
research
07/22/2014

Global optimization using Lévy flights

This paper studies a class of enhanced diffusion processes in which rand...
research
02/04/2005

Oiling the Wheels of Change: The Role of Adaptive Automatic Problem Decomposition in Non--Stationary Environments

Genetic algorithms (GAs) that solve hard problems quickly, reliably and ...
research
03/28/2022

Composite Anderson acceleration method with dynamic window-sizes and optimized damping

In this paper, we propose and analyze a set of fully non-stationary Ande...

Please sign up or login with your details

Forgot password? Click here to reset