Prior-free Data Acquisition for Accurate Statistical Estimation

11/30/2018
by   Yiling Chen, et al.
0

We study a data analyst's problem of acquiring data from self-interested individuals to obtain an accurate estimation of some statistic of a population, subject to an expected budget constraint. Each data holder incurs a cost, which is unknown to the data analyst, to acquire and report his data. The cost can be arbitrarily correlated with the data. The data analyst has an expected budget that she can use to incentivize individuals to provide their data. The goal is to design a joint acquisition-estimation mechanism to optimize the performance of the produced estimator, without any prior information on the underlying distribution of cost and data. We investigate two types of estimations: unbiased point estimation and confidence interval estimation. Unbiased estimators: We design a truthful, individually rational, online mechanism to acquire data from individuals and output an unbiased estimator of the population mean when the data analyst has no prior information on the cost-data distribution and individuals arrive in a random order. The performance of this mechanism matches that of the optimal mechanism, which knows the true cost distribution, within a constant factor. The performance of an estimator is evaluated by its variance under the worst-case cost-data correlation. Confidence intervals: We characterize an approximately optimal (within a factor 2) mechanism for obtaining a confidence interval of the population mean when the data analyst knows the true cost distribution at the beginning. This mechanism is efficiently computable. We then design a truthful, individually rational, online algorithm that is only worse than the approximately optimal mechanism by a constant factor. The performance of an estimator is evaluated by its expected length under the worst-case cost-data correlation.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/03/2017

Optimal Data Acquisition for Statistical Estimation

We consider a data analyst's problem of purchasing data from strategic a...
research
05/29/2021

The Privacy Paradox and Optimal Bias-Variance Trade-offs in Data Acquisition

While users claim to be concerned about privacy, often they do little to...
research
11/24/2020

Optimal Mean Estimation without a Variance

We study the problem of heavy-tailed mean estimation in settings where t...
research
12/27/2021

Faster Algorithms and Constant Lower Bounds for the Worst-Case Expected Error

The study of statistical estimation without distributional assumptions o...
research
01/28/2020

Benchmark Design and Prior-independent Optimization

This paper compares two leading approaches for robust optimization in th...
research
10/01/2021

Confidence intervals for efficiencies in particle physics experiments

We compute bias and variance of an efficiency estimator for a random pro...
research
01/28/2021

Seroprevalence of SARS-CoV-2 antibodies in South Korea

In 2020, Korea Disease Control and Prevention Agency reported three roun...

Please sign up or login with your details

Forgot password? Click here to reset