Cross-Entropy method: convergence issues for extended implementation

09/16/2006
by   Frederic Dambreville, et al.
0

The cross-entropy method (CE) developed by R. Rubinstein is an elegant practical principle for simulating rare events. The method approximates the probability of the rare event by means of a family of probabilistic models. The method has been extended to optimization, by considering an optimal event as a rare event. CE works rather good when dealing with deterministic function optimization. Now, it appears that two conditions are needed for a good convergence of the method. First, it is necessary to have a family of models sufficiently flexible for discriminating the optimal events. Indirectly, it appears also that the function to be optimized should be deterministic. The purpose of this paper is to consider the case of partially discriminating model family, and of stochastic functions. It will be shown on simple examples that the CE could fail when relaxing these hypotheses. Alternative improvements of the CE method are investigated and compared on random examples in order to handle this issue.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/02/2020

Cross-entropy method in application to SIRC model

The study considers the usage of a probabilistic optimization method cal...
research
12/21/2020

Improvement of the cross-entropy method in high dimension through a one-dimensional projection without gradient estimation

Rare event probability estimation is an important topic in reliability a...
research
06/09/2020

Cross-entropy-based importance sampling with failure-informed dimension reduction for rare event simulation

The estimation of rare event or failure probabilities in high dimensions...
research
10/12/2021

Rare Events via Cross-Entropy Population Monte Carlo

We present a Cross-Entropy based population Monte Carlo algorithm. This ...
research
09/18/2020

Cross-Entropy Method Variants for Optimization

The cross-entropy (CE) method is a popular stochastic method for optimiz...
research
02/06/2013

Probability Update: Conditioning vs. Cross-Entropy

Conditioning is the generally agreed-upon method for updating probabilit...
research
05/12/2009

Experiment Study of Entropy Convergence of Ant Colony Optimization

Ant colony optimization (ACO) has been applied to the field of combinato...

Please sign up or login with your details

Forgot password? Click here to reset