Linear Matrix Factorization Embeddings for Single-objective Optimization Landscapes

by   Tome Eftimov, et al.

Automated per-instance algorithm selection and configuration have shown promising performances for a number of classic optimization problems, including satisfiability, AI planning, and TSP. The techniques often rely on a set of features that measure some characteristics of the problem instance at hand. In the context of black-box optimization, these features have to be derived from a set of (x,f(x)) samples. A number of different features have been proposed in the literature, measuring, for example, the modality, the separability, or the ruggedness of the instance at hand. Several of the commonly used features, however, are highly correlated. While state-of-the-art machine learning techniques can routinely filter such correlations, they hinder explainability of the derived algorithm design techniques. We therefore propose in this work to pre-process the measured (raw) landscape features through representation learning. More precisely, we show that a linear dimensionality reduction via matrix factorization significantly contributes towards a better detection of correlation between different problem instances – a key prerequisite for successful automated algorithm design.


page 4

page 5


Automated Algorithm Selection for Radar Network Configuration

The configuration of radar networks is a complex problem that is often p...

FastSTMF: Efficient tropical matrix factorization algorithm for sparse data

Matrix factorization, one of the most popular methods in machine learnin...

Explainable Landscape Analysis in Automated Algorithm Performance Prediction

Predicting the performance of an optimization algorithm on a new problem...

Automated Algorithm Selection: Survey and Perspectives

It has long been observed that for practically any computational problem...

Towards Explainable Exploratory Landscape Analysis: Extreme Feature Selection for Classifying BBOB Functions

Facilitated by the recent advances of Machine Learning (ML), the automat...

A Parallel and Efficient Algorithm for Learning to Match

Many tasks in data mining and related fields can be formalized as matchi...

An efficient label-free analyte detection algorithm for time-resolved spectroscopy

Time-resolved spectral techniques play an important analysis tool in man...