Risk-averse Heteroscedastic Bayesian Optimization

11/05/2021
by   Anastasiia Makarova, et al.
11

Many black-box optimization tasks arising in high-stakes applications require risk-averse decisions. The standard Bayesian optimization (BO) paradigm, however, optimizes the expected value only. We generalize BO to trade mean and input-dependent variance of the objective, both of which we assume to be unknown a priori. In particular, we propose a novel risk-averse heteroscedastic Bayesian optimization algorithm (RAHBO) that aims to identify a solution with high return and low noise variance, while learning the noise distribution on the fly. To this end, we model both expectation and variance as (unknown) RKHS functions, and propose a novel risk-aware acquisition function. We bound the regret for our approach and provide a robust rule to report the final decision point for applications where only a single solution must be identified. We demonstrate the effectiveness of RAHBO on synthetic benchmark functions and hyperparameter tuning tasks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/10/2020

Bayesian Optimization of Risk Measures

We consider Bayesian optimization of objective functions of the form ρ[ ...
research
06/23/2023

Safe Risk-averse Bayesian Optimization for Controller Tuning

Controller tuning and parameter optimization are crucial in system desig...
research
10/07/2022

Neighbor Regularized Bayesian Optimization for Hyperparameter Optimization

Bayesian Optimization (BO) is a common solution to search optimal hyperp...
research
05/15/2020

Excursion Search for Constrained Bayesian Optimization under a Limited Budget of Failures

When learning to ride a bike, a child falls down a number of times befor...
research
01/11/2023

Robust Bayesian Target Value Optimization

We consider the problem of finding an input to a stochastic black box fu...
research
09/17/2020

Mean-Variance Analysis in Bayesian Optimization under Uncertainty

We consider active learning (AL) in an uncertain environment in which tr...
research
05/24/2019

Efficient Batch Black-box Optimization with Deterministic Regret Bounds

In this work, we investigate black-box optimization from the perspective...

Please sign up or login with your details

Forgot password? Click here to reset