Order-Optimal Error Bounds for Noisy Kernel-Based Bayesian Quadrature

02/22/2022
by   Xu Cai, et al.
0

In this paper, we study the sample complexity of noisy Bayesian quadrature (BQ), in which we seek to approximate an integral based on noisy black-box queries to the underlying function. We consider functions in a Reproducing Kernel Hilbert Space (RKHS) with the Matérn-ν kernel, focusing on combinations of the parameter ν and dimension d such that the RKHS is equivalent to a Sobolev class. In this setting, we provide near-matching upper and lower bounds on the best possible average error. Specifically, we find that when the black-box queries are subject to Gaussian noise having variance σ^2, any algorithm making at most T queries (even with adaptive sampling) must incur a mean absolute error of Ω(T^-ν/d-1 + σ T^-1/2), and there exists a non-adaptive algorithm attaining an error of at most O(T^-ν/d-1 + σ T^-1/2). Hence, the bounds are order-optimal, and establish that there is no adaptivity gap in terms of scaling laws.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/31/2017

Lower Bounds on Regret for Noisy Gaussian Process Bandit Optimization

In this paper, we consider the problem of sequentially optimizing a blac...
research
06/21/2023

On the Optimal Bounds for Noisy Computing

We revisit the problem of computing with noisy information considered in...
research
08/20/2020

On Lower Bounds for Standard and Robust Gaussian Process Bandit Optimization

In this paper, we consider algorithm-independent lower bounds for the pr...
research
09/16/2019

Bayesian Optimization under Heavy-tailed Payoffs

We consider black box optimization of an unknown function in the nonpara...
research
09/20/2022

Lower Bounds on the Worst-Case Complexity of Efficient Global Optimization

Efficient global optimization is a widely used method for optimizing exp...
research
09/07/2023

Noisy Computing of the 𝖮𝖱 and 𝖬𝖠𝖷 Functions

We consider the problem of computing a function of n variables using noi...
research
08/02/2017

Streaming kernel regression with provably adaptive mean, variance, and regularization

We consider the problem of streaming kernel regression, when the observa...

Please sign up or login with your details

Forgot password? Click here to reset