Robust estimation of the mean with bounded relative standard deviation

08/15/2019
by   Mark Huber, et al.
0

Many randomized approximation algorithms operate by giving a procedure for simulating a random variable X which has mean μ equal to the target answer, and a relative standard deviation bounded above by a known constant c. Examples of this type of algorithm includes methods for approximating the number of satisfying assignments to 2-SAT or DNF, the volume of a convex body, and the partition function of a Gibbs distribution. Because the answer is usually exponentially large in the problem input size, it is typical to require an estimate μ̂ satisfy P(|μ̂/μ - 1| > ϵ) ≤δ, where ϵ and δ are user specified nonnegative parameters. The current best algorithm uses 2c^2ϵ^-2(1+ϵ)^2 ln(2/δ) samples to achieve such an estimate. By modifying the algorithm in order to balance the tails, it is possible to improve this result to 2(c^2ϵ^-2 + 1)/(1-ϵ^2)ln(2/δ) samples. Aside from the theoretical improvement, we also consider how to best implement this algorithm in practice. Numerical experiments show the behavior of the estimator on distributions where the relative standard deviation is unknown or infinite.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/20/2016

Dealing with Range Anxiety in Mean Estimation via Statistical Queries

We give algorithms for estimating the expectation of a given real-valued...
research
06/27/2019

Chi-squared Test for Binned, Gaussian Samples

We examine the χ^2 test for binned, Gaussian samples, including effects ...
research
10/23/2022

Tight relative estimation in the mean of Bernoulli random variables

Given a stream of Bernoulli random variables, consider the problem of es...
research
02/01/2014

Performance of the Survey Propagation-guided decimation algorithm for the random NAE-K-SAT problem

We show that the Survey Propagation-guided decimation algorithm fails to...
research
01/04/2018

How to estimate the sample mean and standard deviation from the five number summary?

In some clinical studies, researchers may report the five number summary...
research
11/21/2022

Estimating the Effective Support Size in Constant Query Complexity

Estimating the support size of a distribution is a well-studied problem ...
research
01/27/2023

Robust variance-regularized risk minimization with concomitant scaling

Under losses which are potentially heavy-tailed, we consider the task of...

Please sign up or login with your details

Forgot password? Click here to reset