Robust Mean Estimation with the Bayesian Median of Means

06/04/2019
by   Paulo Orenstein, et al.
0

The sample mean is often used to aggregate different unbiased estimates of a parameter, producing a final estimate that is unbiased but possibly high-variance. This paper introduces the Bayesian median of means, an aggregation rule that roughly interpolates between the sample mean and median, resulting in estimates with much smaller variance at the expense of bias. While the procedure is non-parametric, its squared bias is asymptotically negligible relative to the variance, similar to maximum likelihood estimators. The Bayesian median of means is consistent, and concentration bounds for the estimator's bias and L_1 error are derived, as well as a fast non-randomized approximating algorithm. The performances of both the exact and the approximate procedures match that of the sample mean in low-variance settings, and exhibit much better results in high-variance scenarios. The empirical performances are examined in real and simulated data, and in applications such as importance sampling, cross-validation and bagging.

READ FULL TEXT
research
10/25/2018

Finite-sample Guarantees for Winsorized Importance Sampling

Importance sampling is a widely used technique to estimate the propertie...
research
10/13/2019

Empirical and Constrained Empirical Bayes Variance Estimation Under A One Unit Per Stratum Sample Design

A single primary sampling unit (PSU) per stratum design is a popular des...
research
02/28/2013

Estimating the Maximum Expected Value: An Analysis of (Nested) Cross Validation and the Maximum Sample Average

We investigate the accuracy of the two most common estimators for the ma...
research
01/05/2022

Reducing bias and variance in quantile estimates with an exponential model

Percentiles and more generally, quantiles are commonly used in various c...
research
05/05/2020

Bias-Variance Tradeoffs in Joint Spectral Embeddings

Latent position models and their corresponding estimation procedures off...
research
06/30/2023

Bias-Free Estimation of Signals on Top of Unknown Backgrounds

We present a method for obtaining unbiased signal estimates in the prese...
research
06/30/2021

Do we need to estimate the variance in robust mean estimation?

This paper studies robust mean estimators for distributions with only fi...

Please sign up or login with your details

Forgot password? Click here to reset