Enhancing Gaussian Estimation of Distribution Algorithm by Exploiting Evolution Direction with Archive

by   Yongsheng Liang, et al.

As a typical model-based evolutionary algorithm (EA), estimation of distribution algorithm (EDA) possesses unique characteristics and has been widely applied to global optimization. However, the common-used Gaussian EDA (GEDA) usually suffers from premature convergence which severely limits its search efficiency. This study first systematically analyses the reasons for the deficiency of the traditional GEDA, then tries to enhance its performance by exploiting its evolution direction, and finally develops a new GEDA variant named EDA2. Instead of only utilizing some good solutions produced in the current generation when estimating the Gaussian model, EDA2 preserves a certain number of high-quality solutions generated in previous generations into an archive and takes advantage of these historical solutions to assist estimating the covariance matrix of Gaussian model. By this means, the evolution direction information hidden in the archive is naturally integrated into the estimated model which in turn can guide EDA2 towards more promising solution regions. Moreover, the new estimation method significantly reduces the population size of EDA2 since it needs fewer individuals in the current population for model estimation. As a result, a fast convergence can be achieved. To verify the efficiency of EDA2, we tested it on a variety of benchmark functions and compared it with several state-of-the-art EAs, including IPOP-CMAES, AMaLGaM, three high-powered DE algorithms, and a new PSO algorithm. The experimental results demonstrate that EDA2 is efficient and competitive.



There are no comments yet.


page 1

page 2

page 3

page 4


Niching an Archive-based Gaussian Estimation of Distribution Algorithm via Adaptive Clustering

As a model-based evolutionary algorithm, estimation of distribution algo...

A Study on the Global Convergence Time Complexity of Estimation of Distribution Algorithms

The Estimation of Distribution Algorithm is a new class of population ba...

A Fast and Efficient Stochastic Opposition-Based Learning for Differential Evolution in Numerical Optimization

A new variant of stochastic opposition-based learning (OBL) is proposed ...

Memetic Viability Evolution for Constrained Optimization

The performance of evolutionary algorithms can be heavily undermined whe...

Orthogonal learning covariance matrix for defect of grey wolf optimizer: Insights, balance, diversity, and feature selection

This research’s genesis is in two aspects: first, a guaranteed solution ...

Student's t Distribution based Estimation of Distribution Algorithms for Derivative-free Global Optimization

In this paper, we are concerned with a branch of evolutionary algorithms...

On the Covariance-Hessian Relation in Evolution Strategies

We consider Evolution Strategies operating only with isotropic Gaussian ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.