Bayesian Optimization with Dimension Scheduling: Application to Biological Systems

11/17/2015
by   Doniyor Ulmasov, et al.
0

Bayesian Optimization (BO) is a data-efficient method for global black-box optimization of an expensive-to-evaluate fitness function. BO typically assumes that computation cost of BO is cheap, but experiments are time consuming or costly. In practice, this allows us to optimize ten or fewer critical parameters in up to 1,000 experiments. But experiments may be less expensive than BO methods assume: In some simulation models, we may be able to conduct multiple thousands of experiments in a few hours, and the computational burden of BO is no longer negligible compared to experimentation time. To address this challenge we introduce a new Dimension Scheduling Algorithm (DSA), which reduces the computational burden of BO for many experiments. The key idea is that DSA optimizes the fitness function only along a small set of dimensions at each iteration. This DSA strategy (1) reduces the necessary computation time, (2) finds good solutions faster than the traditional BO method, and (3) can be parallelized straightforwardly. We evaluate the DSA in the context of optimizing parameters of dynamic models of microalgae metabolism and show faster convergence than traditional BO.

READ FULL TEXT
research
03/21/2023

Bayesian Optimization for Function Compositions with Applications to Dynamic Pricing

Bayesian Optimization (BO) is used to find the global optima of black bo...
research
05/18/2023

Neuromorphic Bayesian Optimization in Lava

The ever-increasing demands of computationally expensive and high-dimens...
research
05/23/2019

Bayesian Optimization over Sets

We propose a Bayesian optimization method over sets, to minimize a black...
research
02/27/2014

Bayesian Multi-Scale Optimistic Optimization

Bayesian optimization is a powerful global optimization technique for ex...
research
03/22/2020

Cost-aware Bayesian Optimization

Bayesian optimization (BO) is a class of global optimization algorithms,...
research
07/01/2022

Asynchronous Distributed Bayesian Optimization at HPC Scale

Bayesian optimization (BO) is a widely used approach for computationally...
research
10/21/2019

Integrals over Gaussians under Linear Domain Constraints

Integrals of linearly constrained multivariate Gaussian densities are a ...

Please sign up or login with your details

Forgot password? Click here to reset