PARyOpt: A software for Parallel Asynchronous Remote Bayesian Optimization

PARyOpt is a python based implementation of the Bayesian optimization routine designed for remote and asynchronous function evaluations. Bayesian optimization is especially attractive for computational optimization due to its low cost function footprint as well as the ability to account for uncertainties in data. A key challenge to efficiently deploy any optimization strategy on distributed computing systems is the synchronization step, where data from multiple function calls is assimilated to identify the next campaign of function calls. Bayesian optimization provides an elegant approach to overcome this issue via asynchronous updates. We formulate, develop and implement a parallel, asynchronous variant of Bayesian optimization. The framework is robust and resilient to external failures. We show how such asynchronous evaluations help reduce the total optimization wall clock time for a suite of test problems. Additionally, we show how the software design of the framework allows easy extension to response surface reconstruction (Kriging), providing a high performance software for autonomous exploration. The software is available on PyPI, with examples and documentation.

READ FULL TEXT

page 1

page 5

page 10

page 14

research
07/01/2018

New Heuristics for Parallel and Scalable Bayesian Optimization

Bayesian optimization has emerged as a strong candidate tool for global ...
research
06/24/2020

Simple and Scalable Parallelized Bayesian Optimization

In recent years, leveraging parallel and distributed computational resou...
research
10/07/2013

Bayesian Optimization With Censored Response Data

Bayesian optimization (BO) aims to minimize a given blackbox function us...
research
11/11/2022

Combining Multi-Fidelity Modelling and Asynchronous Batch Bayesian Optimization

Bayesian Optimization is a useful tool for experiment design. Unfortunat...
research
07/30/2019

pySOT and POAP: An event-driven asynchronous framework for surrogate optimization

This paper describes Plumbing for Optimization with Asynchronous Paralle...
research
03/24/2020

Model-based Asynchronous Hyperparameter Optimization

We introduce a model-based asynchronous multi-fidelity hyperparameter op...
research
05/25/2017

Asynchronous Parallel Bayesian Optimisation via Thompson Sampling

We design and analyse variations of the classical Thompson sampling (TS)...

Please sign up or login with your details

Forgot password? Click here to reset