PARyOpt: A software for Parallel Asynchronous Remote Bayesian Optimization

09/12/2018
by   Balaji Sesha Sarath Pokuri, et al.
0

PARyOpt is a python based implementation of the Bayesian optimization routine designed for remote and asynchronous function evaluations. Bayesian optimization is especially attractive for computational optimization due to its low cost function footprint as well as the ability to account for uncertainties in data. A key challenge to efficiently deploy any optimization strategy on distributed computing systems is the synchronization step, where data from multiple function calls is assimilated to identify the next campaign of function calls. Bayesian optimization provides an elegant approach to overcome this issue via asynchronous updates. We formulate, develop and implement a parallel, asynchronous variant of Bayesian optimization. The framework is robust and resilient to external failures. We show how such asynchronous evaluations help reduce the total optimization wall clock time for a suite of test problems. Additionally, we show how the software design of the framework allows easy extension to response surface reconstruction (Kriging), providing a high performance software for autonomous exploration. The software is available on PyPI, with examples and documentation.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 5

page 10

page 14

07/01/2018

New Heuristics for Parallel and Scalable Bayesian Optimization

Bayesian optimization has emerged as a strong candidate tool for global ...
06/24/2020

Simple and Scalable Parallelized Bayesian Optimization

In recent years, leveraging parallel and distributed computational resou...
10/07/2013

Bayesian Optimization With Censored Response Data

Bayesian optimization (BO) aims to minimize a given blackbox function us...
07/30/2019

pySOT and POAP: An event-driven asynchronous framework for surrogate optimization

This paper describes Plumbing for Optimization with Asynchronous Paralle...
03/24/2020

Model-based Asynchronous Hyperparameter Optimization

We introduce a model-based asynchronous multi-fidelity hyperparameter op...
08/12/2021

Scalable3-BO: Big Data meets HPC - A scalable asynchronous parallel high-dimensional Bayesian optimization framework on supercomputers

Bayesian optimization (BO) is a flexible and powerful framework that is ...
03/04/2020

Asynchronous effects

We explore asynchronous programming with algebraic effects. We complemen...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.