Black-box Mixed-Variable Optimisation using a Surrogate Model that Satisfies Integer Constraints

06/08/2020
by   Laurens Bliek, et al.
0

A challenging problem in both engineering and computer science is that of minimising a function for which we have no mathematical formulation available, that is expensive to evaluate, and that contains continuous and integer variables, for example in automatic algorithm configuration. Surrogate modelling techniques are very suitable for this type of problem, but most existing techniques are designed with only continuous or only discrete variables in mind. Mixed-Variable ReLU-based Surrogate Modelling (MVRSM) is a surrogate modelling algorithm that uses a linear combination of rectified linear units, defined in such a way that (local) optima satisfy the integer constraints. This method is both more accurate and more efficient than the state of the art on several benchmarks with up to 238 continuous and integer variables.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/02/2019

Mixed-Variable Bayesian Optimization

The optimization of expensive to evaluate, black-box, mixed-variable fun...
research
07/06/2019

ReLU Networks as Surrogate Models in Mixed-Integer Linear Programs

We consider the embedding of piecewise-linear deep neural networks (ReLU...
research
02/10/2022

Bayesian Optimisation for Mixed-Variable Inputs using Value Proposals

Many real-world optimisation problems are defined over both categorical ...
research
04/22/2022

Lossy compression of matrices by black-box optimisation of mixed-integer non-linear programming

In edge computing, suppressing data size is a challenge for machine lear...
research
11/20/2018

Strong mixed-integer programming formulations for trained neural networks

We present an ideal mixed-integer programming (MIP) formulation for a re...
research
02/13/2018

Numerical modelling of a peripheral arterial stenosis using dimensionally reduced models and machine learning techniques

In this work, we consider two kinds of model reduction techniques to sim...
research
02/13/2018

Numerical modelling of a peripheral arterial stenosis using dimensionally reduced models and kernel methods

In this work, we consider two kinds of model reduction techniques to sim...

Please sign up or login with your details

Forgot password? Click here to reset