Information-Theoretic Bounds for Integral Estimation

02/19/2021
by   Donald Q. Adams, et al.
0

In this paper, we consider a zero-order stochastic oracle model of estimating definite integrals. In this model, integral estimation methods may query an oracle function for a fixed number of noisy values of the integrand function and use these values to produce an estimate of the integral. We first show that the information-theoretic error lower bound for estimating the integral of a d-dimensional function over a region with l_∞ radius r using at most T queries to the oracle function is Ω(2^d r^d+1√(d/T)). Additionally, we find that the Gaussian Quadrature method under the same model achieves a rate of O(2^dr^d/√(T)) for functions with zero fourth and higher-order derivatives with respect to individual dimensions, and for Gaussian oracles, this rate is tight. For functions with nonzero fourth derivatives, the Gaussian Quadrature method achieves an upper bound which is not tight with the information-theoretic lower bound. Therefore, it is not minimax optimal, so there is space for the development of better integral estimation methods for such functions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/31/2020

Information-Theoretic Lower Bounds for Zero-Order Stochastic Gradient Estimation

In this paper we analyze the necessary number of samples to estimate the...
research
02/23/2022

Minimax Optimal Quantization of Linear Models: Information-Theoretic Limits and Efficient Algorithms

We consider the problem of quantizing a linear model learned from measur...
research
12/05/2022

On the exact region determined by Spearman's rho and Spearman's footrule

We determine the lower bound for possible values of Spearman's rho of a ...
research
01/25/2019

Communication Complexity of Estimating Correlations

We characterize the communication complexity of the following distribute...
research
11/19/2021

Achievability and Impossibility of Exact Pairwise Ranking

We consider the problem of recovering the rank of a set of n items based...
research
05/01/2023

Exactly Tight Information-Theoretic Generalization Error Bound for the Quadratic Gaussian Problem

We provide a new information-theoretic generalization error bound that i...
research
05/24/2020

Cumulant methods in the estimation of response functions in time-invariant linear systems

Thesis is devoted to the application of cumulant analysis in the estimat...

Please sign up or login with your details

Forgot password? Click here to reset