DeepAI AI Chat
Log In Sign Up

Black-box Mixed-Variable Optimisation using a Surrogate Model that Satisfies Integer Constraints

by   Laurens Bliek, et al.
Delft University of Technology

A challenging problem in both engineering and computer science is that of minimising a function for which we have no mathematical formulation available, that is expensive to evaluate, and that contains continuous and integer variables, for example in automatic algorithm configuration. Surrogate modelling techniques are very suitable for this type of problem, but most existing techniques are designed with only continuous or only discrete variables in mind. Mixed-Variable ReLU-based Surrogate Modelling (MVRSM) is a surrogate modelling algorithm that uses a linear combination of rectified linear units, defined in such a way that (local) optima satisfy the integer constraints. This method is both more accurate and more efficient than the state of the art on several benchmarks with up to 238 continuous and integer variables.


page 1

page 2

page 3

page 4


Mixed-Variable Bayesian Optimization

The optimization of expensive to evaluate, black-box, mixed-variable fun...

ReLU Networks as Surrogate Models in Mixed-Integer Linear Programs

We consider the embedding of piecewise-linear deep neural networks (ReLU...

Bayesian Optimisation for Mixed-Variable Inputs using Value Proposals

Many real-world optimisation problems are defined over both categorical ...

Lossy compression of matrices by black-box optimisation of mixed-integer non-linear programming

In edge computing, suppressing data size is a challenge for machine lear...

Numerical modelling of a peripheral arterial stenosis using dimensionally reduced models and kernel methods

In this work, we consider two kinds of model reduction techniques to sim...

CMA-ES with Margin: Lower-Bounding Marginal Probability for Mixed-Integer Black-Box Optimization

This study targets the mixed-integer black-box optimization (MI-BBO) pro...