MISO-wiLDCosts: Multi Information Source Optimization with Location Dependent Costs

02/09/2021
by   Antonio Candelieri, et al.
0

This paper addresses black-box optimization over multiple information sources whose both fidelity and query cost change over the search space, that is they are location dependent. The approach uses: (i) an Augmented Gaussian Process, recently proposed in multi-information source optimization as a single model of the objective function over search space and sources, and (ii) a Gaussian Process to model the location-dependent cost of each source. The former is used into a Confidence Bound based acquisition function to select the next source and location to query, while the latter is used to penalize the value of the acquisition depending on the expected query cost for any source-location pair. The proposed approach is evaluated on a set of Hyperparameters Optimization tasks, consisting of two Machine Learning classifiers and three datasets of different sizes.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/25/2020

Green Machine Learning via Augmented Gaussian Processes and Multi-Information Source Optimization

Searching for accurate Machine and Deep Learning models is a computation...
research
06/19/2023

Practical First-Order Bayesian Optimization Algorithms

First Order Bayesian Optimization (FOBO) is a sample efficient sequentia...
research
02/26/2019

Multiscale Gaussian Process Level Set Estimation

In this paper, the problem of estimating the level set of a black-box fu...
research
10/27/2020

A Computationally Efficient Approach to Black-box Optimization using Gaussian Process Models

We consider the sequential optimization of an unknown function from nois...
research
04/28/2016

A Probabilistic Adaptive Search System for Exploring the Face Space

Face recall is a basic human cognitive process performed routinely, e.g....
research
03/27/2019

Active Multi-Information Source Bayesian Quadrature

Bayesian quadrature (BQ) is a sample-efficient probabilistic numerical m...
research
09/13/2018

Laplace Inference for Multi-fidelity Gaussian Process Classification

In this paper we address a classification problem where two sources of l...

Please sign up or login with your details

Forgot password? Click here to reset