Explainable Landscape-Aware Optimization Performance Prediction

10/22/2021
by   Risto Trajanov, et al.
0

Efficient solving of an unseen optimization problem is related to appropriate selection of an optimization algorithm and its hyper-parameters. For this purpose, automated algorithm performance prediction should be performed that in most commonly-applied practices involves training a supervised ML algorithm using a set of problem landscape features. However, the main issue of training such models is their limited explainability since they only provide information about the joint impact of the set of landscape features to the end prediction results. In this study, we are investigating explainable landscape-aware regression models where the contribution of each landscape feature to the prediction of the optimization algorithm performance is estimated on a global and local level. The global level provides information about the impact of the feature across all benchmark problems' instances, while the local level provides information about the impact on a specific problem instance. The experimental results are obtained using the COCO benchmark problems and three differently configured modular CMA-ESs. The results show a proof of concept that different set of features are important for different problem instances, which indicates that further personalization of the landscape space is required when training an automated algorithm performance prediction model.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/22/2022

Explainable Landscape Analysis in Automated Algorithm Performance Prediction

Predicting the performance of an optimization algorithm on a new problem...
research
04/15/2022

The Importance of Landscape Features for Performance Prediction of Modular CMA-ES Variants

Selecting the most suitable algorithm and determining its hyperparameter...
research
06/27/2022

Toward an ImageNet Library of Functions for Global Optimization Benchmarking

Knowledge of search-landscape features of BlackBox Optimization (BBO) pr...
research
09/28/2021

Extensible Logging and Empirical Attainment Function for IOHexperimenter

In order to allow for large-scale, landscape-aware, per-instance algorit...
research
06/01/2023

Algorithm Instance Footprint: Separating Easily Solvable and Challenging Problem Instances

In black-box optimization, it is essential to understand why an algorith...
research
02/01/2021

Towards Explainable Exploratory Landscape Analysis: Extreme Feature Selection for Classifying BBOB Functions

Facilitated by the recent advances of Machine Learning (ML), the automat...
research
04/13/2022

Trajectory-based Algorithm Selection with Warm-starting

Landscape-aware algorithm selection approaches have so far mostly been r...

Please sign up or login with your details

Forgot password? Click here to reset