A Nested Weighted Tchebycheff Multi-Objective Bayesian Optimization Approach for Flexibility of Unknown Utopia Estimation in Expensive Black-box Design Problems

10/16/2021
by   Arpan Biswas, et al.
0

We propose a nested weighted Tchebycheff Multi-objective Bayesian optimization framework where we build a regression model selection procedure from an ensemble of models, towards better estimation of the uncertain parameters of the weighted-Tchebycheff expensive black-box multi-objective function. In existing work, a weighted Tchebycheff MOBO approach has been demonstrated which attempts to estimate the unknown utopia in formulating acquisition function, through calibration using a priori selected regression model. However, the existing MOBO model lacks flexibility in selecting the appropriate regression models given the guided sampled data and therefore, can under-fit or over-fit as the iterations of the MOBO progress, reducing the overall MOBO performance. As it is too complex to a priori guarantee a best model in general, this motivates us to consider a portfolio of different families of predictive models fitted with current training data, guided by the WTB MOBO; the best model is selected following a user-defined prediction root mean-square-error-based approach. The proposed approach is implemented in optimizing a multi-modal benchmark problem and a thin tube design under constant loading of temperature-pressure, with minimizing the risk of creep-fatigue failure and design cost. Finally, the nested weighted Tchebycheff MOBO model performance is compared with different MOBO frameworks with respect to accuracy in parameter estimation, Pareto-optimal solutions and function evaluation cost. This method is generalized enough to consider different families of predictive models in the portfolio for best model selection, where the overall design architecture allows for solving any high-dimensional (multiple functions) complex black-box problems and can be extended to any other global criterion multi-objective optimization methods where prior knowledge of utopia is required.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/30/2022

Bayesian Optimization For Multi-Objective Mixed-Variable Problems

Optimizing multiple, non-preferential objectives for mixed-variable, exp...
research
01/12/2020

Stepwise Model Selection for Sequence Prediction via Deep Kernel Learning

An essential problem in automated machine learning (AutoML) is that of m...
research
03/09/2017

mlrMBO: A Modular Framework for Model-Based Optimization of Expensive Black-Box Functions

We present mlrMBO, a flexible and comprehensive R toolbox for model-base...
research
03/28/2012

A Multi-objective Exploratory Procedure for Regression Model Selection

Variable selection is recognized as one of the most critical steps in st...
research
02/15/2022

Robust Multi-Objective Bayesian Optimization Under Input Noise

Bayesian optimization (BO) is a sample-efficient approach for tuning des...
research
10/25/2018

Model Selection using Multi-Objective Optimization

Choices in scientific research and management require balancing multiple...
research
04/08/2021

Multi-Objective Optimization of a Path-following MPC for Vehicle Guidance: A Bayesian Optimization Approach

This paper tackles the multi-objective optimization of the cost function...

Please sign up or login with your details

Forgot password? Click here to reset