The Impact of Hyper-Parameter Tuning for Landscape-Aware Performance Regression and Algorithm Selection

04/19/2021
by   Anja Jankovic, et al.
6

Automated algorithm selection and configuration methods that build on exploratory landscape analysis (ELA) are becoming very popular in Evolutionary Computation. However, despite a significantly growing number of applications, the underlying machine learning models are often chosen in an ad-hoc manner. We show in this work that three classical regression methods are able to achieve meaningful results for ELA-based algorithm selection. For those three models – random forests, decision trees, and bagging decision trees – the quality of the regression models is highly impacted by the chosen hyper-parameters. This has significant effects also on the quality of the algorithm selectors that are built on top of these regressions. By comparing a total number of 30 different models, each coupled with 2 complementary regression strategies, we derive guidelines for the tuning of the regression models and provide general recommendations for a more systematic use of classical machine learning models in landscape-aware algorithm selection. We point out that a choice of the machine learning model merits to be carefully undertaken and further investigated.

READ FULL TEXT

page 4

page 5

page 7

page 8

research
06/01/2021

Decision Concept Lattice vs. Decision Trees and Random Forests

Decision trees and their ensembles are very popular models of supervised...
research
06/17/2020

Landscape-Aware Fixed-Budget Performance Regression and Algorithm Selection for Modular CMA-ES Variants

Automated algorithm selection promises to support the user in the decisi...
research
04/12/2019

Boosting insights in insurance tariff plans with tree-based machine learning

Pricing actuaries typically stay within the framework of generalized lin...
research
10/20/2022

Predicting school transition rates in Austria with classification trees

Methods based on machine learning become increasingly popular in many ar...
research
06/14/2021

Discovering Interpretable Machine Learning Models in Parallel Coordinates

This paper contributes to interpretable machine learning via visual know...
research
12/15/2021

Breeding realistic D-brane models

Intersecting branes provide a useful mechanism to construct particle phy...
research
04/13/2022

Trajectory-based Algorithm Selection with Warm-starting

Landscape-aware algorithm selection approaches have so far mostly been r...

Please sign up or login with your details

Forgot password? Click here to reset