Learning How to Optimize Black-Box Functions With Extreme Limits on the Number of Function Evaluations

03/18/2021
by   Carlos Ansótegui, et al.
0

We consider black-box optimization in which only an extremely limited number of function evaluations, on the order of around 100, are affordable and the function evaluations must be performed in even fewer batches of a limited number of parallel trials. This is a typical scenario when optimizing variable settings that are very costly to evaluate, for example in the context of simulation-based optimization or machine learning hyperparameterization. We propose an original method that uses established approaches to propose a set of points for each batch and then down-selects from these candidate points to the number of trials that can be run in parallel. The key novelty of our approach lies in the introduction of a hyperparameterized method for down-selecting the number of candidates to the allowed batch-size, which is optimized offline using automated algorithm configuration. We tune this method for black box optimization and then evaluate on classical black box optimization benchmarks. Our results show that it is possible to learn how to combine evaluation points suggested by highly diverse black box optimization methods conditioned on the progress of the optimization. Compared with the state of the art in black box minimization and various other methods specifically geared towards few-shot minimization, we achieve an average reduction of 50% of normalized cost, which is a highly significant improvement in performance.

READ FULL TEXT
research
06/12/2023

Diffusion Models for Black-Box Optimization

The goal of offline black-box optimization (BBO) is to optimize an expen...
research
04/24/2023

B2Opt: Learning to Optimize Black-box Optimization with Little Budget

Learning to optimize (L2O) has emerged as a powerful framework for black...
research
06/22/2022

Generative Pretraining for Black-Box Optimization

Many problems in science and engineering involve optimizing an expensive...
research
05/03/2016

Blackbox: A procedure for parallel optimization of expensive black-box functions

This note provides a description of a procedure that is designed to effi...
research
06/05/2020

Population-Based Black-Box Optimization for Biological Sequence Design

The use of black-box optimization for the design of new biological seque...
research
10/01/2021

Surrogate-Based Black-Box Optimization Method for Costly Molecular Properties

AI-assisted molecular optimization is a very active research field as it...
research
10/21/2020

Batch Sequential Adaptive Designs for Global Optimization

Compared with the fixed-run designs, the sequential adaptive designs (SA...

Please sign up or login with your details

Forgot password? Click here to reset