Efficient Statistics, in High Dimensions, from Truncated Samples

09/11/2018
by   Constantinos Daskalakis, et al.
0

We provide an efficient algorithm for the classical problem, going back to Galton, Pearson, and Fisher, of estimating, with arbitrary accuracy the parameters of a multivariate normal distribution from truncated samples. Truncated samples from a d-variate normal N(μ,Σ) means a samples is only revealed if it falls in some subset S ⊆R^d; otherwise the samples are hidden and their count in proportion to the revealed samples is also hidden. We show that the mean μ and covariance matrix Σ can be estimated with arbitrary accuracy in polynomial-time, as long as we have oracle access to S, and S has non-trivial measure under the unknown d-variate normal distribution. Additionally we show that without oracle access to S, any non-trivial estimation is impossible.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/02/2019

Efficient Truncated Statistics with Unknown Truncation

We study the problem of estimating the parameters of a Gaussian distribu...
research
06/17/2020

Efficient Statistics for Sparse Graphical Models from Truncated Samples

In this paper, we study high-dimensional estimation from truncated sampl...
research
03/25/2023

Exact Short Products From Truncated Multipliers

We sometimes need to compute the most significant digits of the product ...
research
10/22/2020

Computationally and Statistically Efficient Truncated Regression

We provide a computationally and statistically efficient estimator for t...
research
04/20/2022

Integral, mean and covariance of the simplex-truncated multivariate normal distribution

Compositional data, which is data consisting of fractions or probabiliti...
research
07/05/2020

Efficient Parameter Estimation of Truncated Boolean Product Distributions

We study the problem of estimating the parameters of a Boolean product d...
research
05/04/2023

Testing Convex Truncation

We study the basic statistical problem of testing whether normally distr...

Please sign up or login with your details

Forgot password? Click here to reset