Parallel Mixed Bayesian Optimization Algorithm: A Scaleup Analysis

06/03/2004
by   Jiri Ocenasek, et al.
0

Estimation of Distribution Algorithms have been proposed as a new paradigm for evolutionary optimization. This paper focuses on the parallelization of Estimation of Distribution Algorithms. More specifically, the paper discusses how to predict performance of parallel Mixed Bayesian Optimization Algorithm (MBOA) that is based on parallel construction of Bayesian networks with decision trees. We determine the time complexity of parallel Mixed Bayesian Optimization Algorithm and compare this complexity with experimental results obtained by solving the spin glass optimization problem. The empirical results fit well the theoretical time complexity, so the scalability and efficiency of parallel Mixed Bayesian Optimization Algorithm for unknown instances of spin glass benchmarks can be predicted. Furthermore, we derive the guidelines that can be used to design effective parallel Estimation of Distribution Algorithms with the speedup proportional to the number of variables in the problem.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/31/2016

Online Optimization with Costly and Noisy Measurements using Random Fourier Expansions

This paper analyzes DONE, an online optimization algorithm that iterativ...
research
02/26/2019

Fully Distributed Bayesian Optimization with Stochastic Policies

Bayesian optimization has become a popular method for high-throughput co...
research
01/11/2012

Distance-Based Bias in Model-Directed Optimization of Additively Decomposable Problems

For many optimization problems it is possible to define a distance metri...
research
05/29/2019

Lifelong Bayesian Optimization

Automatic Machine Learning (Auto-ML) systems tackle the problem of autom...
research
07/02/2023

Bounce: a Reliable Bayesian Optimization Algorithm for Combinatorial and Mixed Spaces

Impactful applications such as materials discovery, hardware design, neu...
research
07/30/2023

Quantum Approximate Bayesian Optimization Algorithms with Two Mixers and Uncertainty Quantification

The searching efficiency of the quantum approximate optimization algorit...
research
01/09/2013

Bayesian Optimization in a Billion Dimensions via Random Embeddings

Bayesian optimization techniques have been successfully applied to robot...

Please sign up or login with your details

Forgot password? Click here to reset