Automated Algorithm Selection on Continuous Black-Box Problems By Combining Exploratory Landscape Analysis and Machine Learning

11/24/2017
by   Pascal Kerschke, et al.
0

In this paper, we build upon previous work on designing informative and efficient Exploratory Landscape Analysis features for characterizing problems' landscapes and show their effectiveness in automatically constructing algorithm selection models in continuous black-box optimization problems. Focussing on algorithm performance results of the COCO platform of several years, we construct a representative set of high-performing complementary solvers and present an algorithm selection model that manages to outperform the single best solver out of the portfolio by factor two. Acting on the assumption that the function set of the Black-Box Optimization Benchmark is representative enough for practical applications the model allows for selecting the best suited optimization algorithm within the considered set for unseen problems prior to the optimization itself based on a small sample of function evaluations. Note that such a sample can even be reused for the initial algorithm population so that feature costs become negligible.

READ FULL TEXT

page 1

page 2

research
09/17/2021

Benchmarking Feature-based Algorithm Selection Systems for Black-box Numerical Optimization

Feature-based algorithm selection aims to automatically find the best on...
research
07/30/2022

HPO X ELA: Investigating Hyperparameter Optimization Landscapes by Means of Exploratory Landscape Analysis

Hyperparameter optimization (HPO) is a key component of machine learning...
research
08/17/2017

Comprehensive Feature-Based Landscape Analysis of Continuous and Constrained Optimization Problems Using the R-Package flacco

Choosing the best-performing optimizer(s) out of a portfolio of optimiza...
research
06/11/2020

Towards Dynamic Algorithm Selection for Numerical Black-Box Optimization: Investigating BBOB as a Use Case

One of the most challenging problems in evolutionary computation is to s...
research
04/12/2022

A Collection of Deep Learning-based Feature-Free Approaches for Characterizing Single-Objective Continuous Fitness Landscapes

Exploratory Landscape Analysis is a powerful technique for numerically c...
research
06/19/2020

Exploratory Landscape Analysis is Strongly Sensitive to the Sampling Strategy

Exploratory landscape analysis (ELA) supports supervised learning approa...
research
03/18/2021

Naive Automated Machine Learning – A Late Baseline for AutoML

Automated Machine Learning (AutoML) is the problem of automatically find...

Please sign up or login with your details

Forgot password? Click here to reset