Automated Dynamic Algorithm Configuration

05/27/2022
by   Steven Adriaensen, et al.
18

The performance of an algorithm often critically depends on its parameter configuration. While a variety of automated algorithm configuration methods have been proposed to relieve users from the tedious and error-prone task of manually tuning parameters, there is still a lot of untapped potential as the learned configuration is static, i.e., parameter settings remain fixed throughout the run. However, it has been shown that some algorithm parameters are best adjusted dynamically during execution, e.g., to adapt to the current part of the optimization landscape. Thus far, this is most commonly achieved through hand-crafted heuristics. A promising recent alternative is to automatically learn such dynamic parameter adaptation policies from data. In this article, we give the first comprehensive account of this new field of automated dynamic algorithm configuration (DAC), present a series of recent advances, and provide a solid foundation for future research in this field. Specifically, we (i) situate DAC in the broader historical context of AI research; (ii) formalize DAC as a computational problem; (iii) identify the methods used in prior-art to tackle this problem; (iv) conduct empirical case studies for using DAC in evolutionary optimization, AI planning, and machine learning.

READ FULL TEXT
research
05/17/2017

Pitfalls and Best Practices in Algorithm Configuration

Good parameter settings are crucial to achieve high performance in many ...
research
02/03/2022

A Survey of Methods for Automated Algorithm Configuration

Algorithm configuration (AC) is concerned with the automated search of t...
research
05/18/2021

DACBench: A Benchmark Library for Dynamic Algorithm Configuration

Dynamic Algorithm Configuration (DAC) aims to dynamically control a targ...
research
02/23/2023

Using Automated Algorithm Configuration for Parameter Control

Dynamic Algorithm Configuration (DAC) tackles the question of how to aut...
research
02/07/2022

Theory-inspired Parameter Control Benchmarks for Dynamic Algorithm Configuration

It has long been observed that the performance of evolutionary algorithm...
research
11/19/2019

On Performance Estimation in Automatic Algorithm Configuration

Over the last decade, research on automated parameter tuning, often refe...
research
05/26/2019

Learning to Optimize Computational Resources: Frugal Training with Generalization Guarantees

Algorithms typically come with tunable parameters that have a considerab...

Please sign up or login with your details

Forgot password? Click here to reset