Transfer Learning, Soft Distance-Based Bias, and the Hierarchical BOA

03/24/2012
by   Martin Pelikan, et al.
0

An automated technique has recently been proposed to transfer learning in the hierarchical Bayesian optimization algorithm (hBOA) based on distance-based statistics. The technique enables practitioners to improve hBOA efficiency by collecting statistics from probabilistic models obtained in previous hBOA runs and using the obtained statistics to bias future hBOA runs on similar problems. The purpose of this paper is threefold: (1) test the technique on several classes of NP-complete problems, including MAXSAT, spin glasses and minimum vertex cover; (2) demonstrate that the technique is effective even when previous runs were done on problems of different size; (3) provide empirical evidence that combining transfer learning with other efficiency enhancement techniques can often yield nearly multiplicative speedups.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/11/2012

Distance-Based Bias in Model-Directed Optimization of Additively Decomposable Problems

For many optimization problems it is possible to define a distance metri...
research
11/22/2021

Transfer Learning with Gaussian Processes for Bayesian Optimization

Bayesian optimization is a powerful paradigm to optimize black-box funct...
research
06/20/2022

A Neural Network Based Method with Transfer Learning for Genetic Data Analysis

Transfer learning has emerged as a powerful technique in many applicatio...
research
05/26/2022

Transfer learning driven design optimization for inertial confinement fusion

Transfer learning is a promising approach to creating predictive models ...
research
09/13/2016

A Generic Bet-and-run Strategy for Speeding Up Traveling Salesperson and Minimum Vertex Cover

A common strategy for improving optimization algorithms is to restart th...
research
10/25/2021

Covariance-Generalized Matching Component Analysis for Data Fusion and Transfer Learning

In order to allow for the encoding of additional statistical information...

Please sign up or login with your details

Forgot password? Click here to reset