A Batched Scalable Multi-Objective Bayesian Optimization Algorithm

11/04/2018
by   Xi Lin, et al.
0

The surrogate-assisted optimization algorithm is a promising approach for solving expensive multi-objective optimization problems. However, most existing surrogate-assisted multi-objective optimization algorithms have three main drawbacks: 1) cannot scale well for solving problems with high dimensional decision space, 2) cannot incorporate available gradient information, and 3) do not support batch optimization. These drawbacks prevent their use for solving many real-world large scale optimization problems. This paper proposes a batched scalable multi-objective Bayesian optimization algorithm to tackle these issues. The proposed algorithm uses the Bayesian neural network as the scalable surrogate model. Powered with Monte Carlo dropout and Sobolov training, the model can be easily trained and can incorporate available gradient information. We also propose a novel batch hypervolume upper confidence bound acquisition function to support batch optimization. Experimental results on various benchmark problems and a real-world application demonstrate the efficiency of the proposed algorithm.

READ FULL TEXT
research
05/07/2019

Bayesian Optimization for Multi-objective Optimization and Multi-point Search

Bayesian optimization is an effective method to efficiently optimize unk...
research
05/16/2022

A model aggregation approach for high-dimensional large-scale optimization

Bayesian optimization (BO) has been widely used in machine learning and ...
research
06/01/2023

Large-Batch, Neural Multi-Objective Bayesian Optimization

Bayesian optimization provides a powerful framework for global optimizat...
research
06/28/2021

An Efficient Batch Constrained Bayesian Optimization Approach for Analog Circuit Synthesis via Multi-objective Acquisition Ensemble

Bayesian optimization is a promising methodology for analog circuit synt...
research
09/18/2022

An Interactive Knowledge-based Multi-objective Evolutionary Algorithm Framework for Practical Optimization Problems

Experienced users often have useful knowledge and intuition in solving r...
research
03/07/2020

Shahryar Origami Optimization (SOO): A Novel Approach for Solving Large-scale Expensive Optimization Problems Efficiently

Many real-world problems are categorized as large-scale problems, and me...
research
06/15/2019

Global optimization via inverse distance weighting

Global optimization problems whose objective function is expensive to ev...

Please sign up or login with your details

Forgot password? Click here to reset