Information-Theoretic Multi-Objective Bayesian Optimization with Continuous Approximations

09/12/2020
by   Syrine Belakaria, et al.
0

Many real-world applications involve black-box optimization of multiple objectives using continuous function approximations that trade-off accuracy and resource cost of evaluation. For example, in rocket launching research, we need to find designs that trade-off return-time and angular distance using continuous-fidelity simulators (e.g., varying tolerance parameter to trade-off simulation time and accuracy) for design evaluations. The goal is to approximate the optimal Pareto set by minimizing the cost for evaluations. In this paper, we propose a novel approach referred to as information-Theoretic Multi-Objective Bayesian Optimization with Continuous Approximations (iMOCA) to solve this problem. The key idea is to select the sequence of input and function approximations for multiple objectives which maximize the information gain per unit cost for the optimal Pareto front. Our experiments on diverse synthetic and real-world benchmarks show that iMOCA significantly improves over existing single-fidelity methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/02/2020

Multi-Fidelity Multi-Objective Bayesian Optimization: An Output Space Entropy Search Approach

We study the novel problem of blackbox optimization of multiple objectiv...
research
04/14/2021

Learning Pareto-Frontier Resource Management Policies for Heterogeneous SoCs: An Information-Theoretic Approach

Mobile system-on-chips (SoCs) are growing in their complexity and hetero...
research
01/18/2020

FlexiBO: Cost-Aware Multi-Objective Optimization of Deep Neural Networks

One of the key challenges in designing machine learning systems is to de...
research
10/13/2021

Output Space Entropy Search Framework for Multi-Objective Bayesian Optimization

We consider the problem of black-box multi-objective optimization (MOO) ...
research
12/27/2021

Expected hypervolume improvement for simultaneous multi-objective and multi-fidelity optimization

Bayesian optimization has proven to be an efficient method to optimize e...
research
02/15/2022

A Light-Weight Multi-Objective Asynchronous Hyper-Parameter Optimizer

We describe a light-weight yet performant system for hyper-parameter opt...
research
04/11/2022

{PF}^2ES: Parallel Feasible Pareto Frontier Entropy Search for Multi-Objective Bayesian Optimization Under Unknown Constraints

We present Parallel Feasible Pareto Frontier Entropy Search ({PF}^2ES) –...

Please sign up or login with your details

Forgot password? Click here to reset