BCMA-ES: A Bayesian approach to CMA-ES

04/02/2019
by   Eric Benhamou, et al.
0

This paper introduces a novel theoretically sound approach for the celebrated CMA-ES algorithm. Assuming the parameters of the multi variate normal distribution for the minimum follow a conjugate prior distribution, we derive their optimal update at each iteration step. Not only provides this Bayesian framework a justification for the update of the CMA-ES algorithm but it also gives two new versions of CMA-ES either assuming normal-Wishart or normal-Inverse Wishart priors, depending whether we parametrize the likelihood by its covariance or precision matrix. We support our theoretical findings by numerical experiments that show fast convergence of these modified versions of CMA-ES.

READ FULL TEXT
research
04/02/2019

BCMA-ES II: revisiting Bayesian CMA-ES

This paper revisits the Bayesian CMA-ES and provides updates for normal ...
research
02/07/2018

Gradient conjugate priors and deep neural networks

The paper deals with learning the probability distribution of the observ...
research
10/07/2021

Estimation of Constrained Mean-Covariance of Normal Distributions

Estimation of the mean vector and covariance matrix is of central import...
research
08/27/2022

Joint distribution properties of Fully Conditional Specification under the normal linear model with normal inverse-gamma priors

Fully conditional specification (FCS) is a convenient and flexible multi...
research
07/02/2021

The Effect of the Prior and the Experimental Design on the Inference of the Precision Matrix in Gaussian Chain Graph Models

Here, we investigate whether (and how) experimental design could aid in ...
research
08/24/2017

Bayesian Compressive Sensing Using Normal Product Priors

In this paper, we introduce a new sparsity-promoting prior, namely, the ...
research
11/19/2021

Impact of spatial coarsening on Parareal convergence

We study the impact of spatial coarsening on the convergence of the Para...

Please sign up or login with your details

Forgot password? Click here to reset