IOHexperimenter: Benchmarking Platform for Iterative Optimization Heuristics

11/07/2021
by   Jacob de Nobel, et al.
0

We present IOHexperimenter, the experimentation module of the IOHprofiler project, which aims at providing an easy-to-use and highly customizable toolbox for benchmarking iterative optimization heuristics such as evolutionary and genetic algorithms, local search algorithms, Bayesian optimization techniques, etc. IOHexperimenter can be used as a stand-alone tool or as part of a benchmarking pipeline that uses other components of IOHprofiler such as IOHanalyzer, the module for interactive performance analysis and visualization. IOHexperimenter provides an efficient interface between optimization problems and their solvers while allowing for granular logging of the optimization process. These logs are fully compatible with existing tools for interactive data analysis, which significantly speeds up the deployment of a benchmarking pipeline. The main components of IOHexperimenter are the environment to build customized problem suites and the various logging options that allow users to steer the granularity of the data records.

READ FULL TEXT
research
07/08/2020

IOHanalyzer: Performance Analysis for Iterative Optimization Heuristic

We propose IOHanalyzer, a new software for analyzing the empirical perfo...
research
12/19/2019

Benchmarking Discrete Optimization Heuristics with IOHprofiler

Automated benchmarking environments aim to support researchers in unders...
research
02/12/2021

Towards Large Scale Automated Algorithm Design by Integrating Modular Benchmarking Frameworks

We present a first proof-of-concept use-case that demonstrates the effic...
research
02/02/2023

Benchmarking Algorithms for Submodular Optimization Problems Using IOHProfiler

Submodular functions play a key role in the area of optimization as they...
research
07/26/2018

A Linear Constrained Optimization Benchmark For Probabilistic Search Algorithms: The Rotated Klee-Minty Problem

The development, assessment, and comparison of randomized search algorit...
research
10/11/2018

IOHprofiler: A Benchmarking and Profiling Tool for Iterative Optimization Heuristics

IOHprofiler is a new tool for analyzing and comparing iterative optimiza...
research
06/16/2023

Framework and Benchmarks for Combinatorial and Mixed-variable Bayesian Optimization

This paper introduces a modular framework for Mixed-variable and Combina...

Please sign up or login with your details

Forgot password? Click here to reset