mlrMBO: A Modular Framework for Model-Based Optimization of Expensive Black-Box Functions

03/09/2017
by   Bernd Bischl, et al.
0

We present mlrMBO, a flexible and comprehensive R toolbox for model-based optimization (MBO), also known as Bayesian optimization, which addresses the problem of expensive black-box optimization by approximating the given objective function through a surrogate regression model. It is designed for both single- and multi-objective optimization with mixed continuous, categorical and conditional parameters. Additional features include multi-point batch proposal, parallelization, visualization, logging and error-handling. mlrMBO is implemented in a modular fashion, such that single components can be easily replaced or adapted by the user for specific use cases, e.g., any regression learner from the mlr toolbox for machine learning can be used, and infill criteria and infill optimizers are easily exchangeable. We empirically demonstrate that mlrMBO provides state-of-the-art performance by comparing it on different benchmark scenarios against a wide range of other optimizers, including DiceOptim, rBayesianOptimization, SPOT, SMAC, Spearmint, and Hyperopt.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/01/2023

Polynomial-Model-Based Optimization for Blackbox Objectives

For a wide range of applications the structure of systems like Neural Ne...
research
01/30/2022

Bayesian Optimization For Multi-Objective Mixed-Variable Problems

Optimizing multiple, non-preferential objectives for mixed-variable, exp...
research
03/02/2015

Bayesian Optimization of Text Representations

When applying machine learning to problems in NLP, there are many choice...
research
02/22/2022

On Uncertainty Estimation by Tree-based Surrogate Models in Sequential Model-based Optimization

Sequential model-based optimization sequentially selects a candidate poi...
research
07/18/2022

Bayesian Optimization for Macro Placement

Macro placement is the problem of placing memory blocks on a chip canvas...
research
02/08/2022

Fourier Representations for Black-Box Optimization over Categorical Variables

Optimization of real-world black-box functions defined over purely categ...

Please sign up or login with your details

Forgot password? Click here to reset