On the Efficient Implementation of High Accuracy Optimality of Profile Maximum Likelihood

10/13/2022
by   Moses Charikar, et al.
0

We provide an efficient unified plug-in approach for estimating symmetric properties of distributions given n independent samples. Our estimator is based on profile-maximum-likelihood (PML) and is sample optimal for estimating various symmetric properties when the estimation error ϵ≫ n^-1/3. This result improves upon the previous best accuracy threshold of ϵ≫ n^-1/4 achievable by polynomial time computable PML-based universal estimators [ACSS21, ACSS20]. Our estimator reaches a theoretical limit for universal symmetric property estimation as [Han21] shows that a broad class of universal estimators (containing many well known approaches including ours) cannot be sample optimal for every 1-Lipschitz property when ϵ≪ n^-1/3.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/21/2019

Efficient Profile Maximum Likelihood for Universal Symmetric Property Estimation

Estimating symmetric properties of a distribution, e.g. support size, co...
research
03/02/2020

A General Framework for Symmetric Property Estimation

In this paper we provide a general framework for estimating symmetric pr...
research
08/27/2020

On the High Accuracy Limitation of Adaptive Property Estimation

Recent years have witnessed the success of adaptive (or unified) approac...
research
11/05/2020

Instance Based Approximations to Profile Maximum Likelihood

In this paper we provide a new efficient algorithm for approximately com...
research
11/08/2019

Unified Sample-Optimal Property Estimation in Near-Linear Time

We consider the fundamental learning problem of estimating properties of...
research
06/10/2019

The Broad Optimality of Profile Maximum Likelihood

We study three fundamental statistical-learning problems: distribution e...
research
04/06/2020

The Bethe and Sinkhorn Permanents of Low Rank Matrices and Implications for Profile Maximum Likelihood

In this paper we consider the problem of computing the likelihood of the...

Please sign up or login with your details

Forgot password? Click here to reset