Distance-Based Bias in Model-Directed Optimization of Additively Decomposable Problems

01/11/2012
by   Martin Pelikan, et al.
0

For many optimization problems it is possible to define a distance metric between problem variables that correlates with the likelihood and strength of interactions between the variables. For example, one may define a metric so that the dependencies between variables that are closer to each other with respect to the metric are expected to be stronger than the dependencies between variables that are further apart. The purpose of this paper is to describe a method that combines such a problem-specific distance metric with information mined from probabilistic models obtained in previous runs of estimation of distribution algorithms with the goal of solving future problem instances of similar type with increased speed, accuracy and reliability. While the focus of the paper is on additively decomposable problems and the hierarchical Bayesian optimization algorithm, it should be straightforward to generalize the approach to other model-directed optimization techniques and other problem classes. Compared to other techniques for learning from experience put forward in the past, the proposed technique is both more practical and more broadly applicable.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/24/2012

Transfer Learning, Soft Distance-Based Bias, and the Hierarchical BOA

An automated technique has recently been proposed to transfer learning i...
research
06/03/2004

Parallel Mixed Bayesian Optimization Algorithm: A Scaleup Analysis

Estimation of Distribution Algorithms have been proposed as a new paradi...
research
03/06/2020

Bayesian optimization of variable-size design space problems

Within the framework of complex system design, it is often necessary to ...
research
02/24/2022

Novel Metric based on Walsh Coefficients for measuring problem difficulty in Estimation of Distribution Algorithms

Estimation of distribution algorithms are evolutionary algorithms that u...
research
02/08/2023

Resistance Distances in Directed Graphs: Definitions, Properties, and Applications

Resistance distance has been studied extensively in the past years, with...
research
07/13/2017

Bayesian Optimization for Probabilistic Programs

We present the first general purpose framework for marginal maximum a po...
research
02/06/2018

Scalable Meta-Learning for Bayesian Optimization

Bayesian optimization has become a standard technique for hyperparameter...

Please sign up or login with your details

Forgot password? Click here to reset