DoE2Vec: Deep-learning Based Features for Exploratory Landscape Analysis

03/31/2023
by   Bas van Stein, et al.
0

We propose DoE2Vec, a variational autoencoder (VAE)-based methodology to learn optimization landscape characteristics for downstream meta-learning tasks, e.g., automated selection of optimization algorithms. Principally, using large training data sets generated with a random function generator, DoE2Vec self-learns an informative latent representation for any design of experiments (DoE). Unlike the classical exploratory landscape analysis (ELA) method, our approach does not require any feature engineering and is easily applicable for high dimensional search spaces. For validation, we inspect the quality of latent reconstructions and analyze the latent representations using different experiments. The latent representations not only show promising potentials in identifying similar (cheap-to-evaluate) surrogate functions, but also can significantly boost performances when being used complementary to the classical ELA features in classification tasks.

READ FULL TEXT

page 3

page 6

page 7

research
03/14/2019

Learning Latent Representations of Bank Customers With The Variational Autoencoder

Learning data representations that reflect the customers' creditworthine...
research
04/18/2023

Computational and Exploratory Landscape Analysis of the GKLS Generator

The GKLS generator is one of the most used testbeds for benchmarking glo...
research
04/12/2022

A Collection of Deep Learning-based Feature-Free Approaches for Characterizing Single-Objective Continuous Fitness Landscapes

Exploratory Landscape Analysis is a powerful technique for numerically c...
research
06/19/2020

Exploratory Landscape Analysis is Strongly Sensitive to the Sampling Strategy

Exploratory landscape analysis (ELA) supports supervised learning approa...
research
11/17/2022

Towards Automated Design of Bayesian Optimization via Exploratory Landscape Analysis

Bayesian optimization (BO) algorithms form a class of surrogate-based he...
research
06/27/2022

Toward an ImageNet Library of Functions for Global Optimization Benchmarking

Knowledge of search-landscape features of BlackBox Optimization (BBO) pr...
research
12/12/2017

In a Nutshell: Sequential Parameter Optimization

The performance of optimization algorithms relies crucially on their par...

Please sign up or login with your details

Forgot password? Click here to reset