Using Affine Combinations of BBOB Problems for Performance Assessment

03/08/2023
by   Diederick Vermetten, et al.
0

Benchmarking plays a major role in the development and analysis of optimization algorithms. As such, the way in which the used benchmark problems are defined significantly affects the insights that can be gained from any given benchmark study. One way to easily extend the range of available benchmark functions is through affine combinations between pairs of functions. From the perspective of landscape analysis, these function combinations smoothly transition between the two base functions. In this work, we show how these affine function combinations can be used to analyze the behavior of optimization algorithms. In particular, we highlight that by varying the weighting between the combined problems, we can gain insights into the effects of added global structure on the performance of optimization algorithms. By analyzing performance trajectories on more function combinations, we also show that aspects such as the scaling of objective functions and placement of the optimum can greatly impact how these results are interpreted.

READ FULL TEXT

page 3

page 4

page 5

page 7

research
08/19/2013

A Literature Survey of Benchmark Functions For Global Optimization Problems

Test functions are important to validate and compare the performance of ...
research
04/27/2021

A Complementarity Analysis of the COCO Benchmark Problems and Artificially Generated Problems

When designing a benchmark problem set, it is important to create a set ...
research
02/09/2022

New hard benchmark functions for global optimization

In this paper, we present some new unimodal, multimodal, and noise test ...
research
07/29/2014

A CUDA-Based Real Parameter Optimization Benchmark

Benchmarking is key for developing and comparing optimization algorithms...
research
07/13/2018

Global optimization test problems based on random field composition

The development and identification of effective optimization algorithms ...
research
04/18/2023

Computational and Exploratory Landscape Analysis of the GKLS Generator

The GKLS generator is one of the most used testbeds for benchmarking glo...

Please sign up or login with your details

Forgot password? Click here to reset