Monte Carlo Integration with adaptive variance selection for improved stochastic Efficient Global Optimization

06/26/2019
by   Felipe Carraro, et al.
0

In this paper, the minimization of computational cost on evaluating multi-dimensional integrals is explored. More specifically, a method based on an adaptive scheme for error variance selection in Monte Carlo integration (MCI) is presented. It uses a stochastic Efficient Global Optimization (sEGO) framework to guide the optimization search. The MCI is employed to approximate the integrals, because it provides the variance of the error in the integration. In the proposed approach, the variance of the integration error is included into a Stochastic Kriging framework by setting a target variance in the MCI. We show that the variance of the error of the MCI may be controlled by the designer and that its value strongly influences the computational cost and the exploration ability of the optimization process. Hence, we propose an adaptive scheme for automatic selection of the target variance during the sEGO search. The robustness and efficiency of the proposed adaptive approach were evaluated on global optimization stochastic benchmark functions as well as on a tuned mass damper design problem. The results showed that the proposed adaptive approach consistently outperformed the constant approach and a multi-start optimization method. Moreover, the use of MCI enabled the method application in problems with high number of stochastic dimensions. On the other hand, the main limitation of the method is inherited from sEGO coupled with the Kriging metamodel: the efficiency of the approach is reduced when the number of design variables increases.

READ FULL TEXT

page 1

page 13

page 15

page 17

page 18

page 20

page 21

page 22

research
02/01/2019

Multi-level Monte Carlo Variational Inference

In many statistics and machine learning frameworks, stochastic optimizat...
research
06/07/2022

Monte Carlo integration with adaptive variance reduction: an asymptotic analysis

The crude Monte Carlo approximates the integral S(f)=∫_a^b f(x) dx ...
research
06/12/2020

Scalable Control Variates for Monte Carlo Methods via Stochastic Optimization

Control variates are a well-established tool to reduce the variance of M...
research
07/26/2020

Langevin Monte Carlo: random coordinate descent and variance reduction

Sampling from a log-concave distribution function on ℝ^d (with d≫ 1) is ...
research
05/24/2019

Computational cost for determining an approximate global minimum using the selection and crossover algorithm

This work examines the expected computational cost to determine an appro...
research
01/15/2022

Self-Adaptive Binary-Addition-Tree Algorithm-Based Novel Monte Carlo Simulation for Binary-State Network Reliability Approximation

The Monte Carlo simulation (MCS) is a statistical methodology used in a ...
research
09/02/2021

Application of Monte Carlo Stochastic Optimization (MOST) to Deep Learning

In this paper, we apply the Monte Carlo stochastic optimization (MOST) p...

Please sign up or login with your details

Forgot password? Click here to reset