No need for an oracle: the nonparametric maximum likelihood decision in the compound decision problem is minimax

09/20/2023
by   Ya'acov Ritov, et al.
0

We discuss the asymptotics of the nonparametric maximum likelihood estimator (NPMLE) in the normal mixture model. We then prove the convergence rate of the NPMLE decision in the empirical Bayes problem with normal observations. We point to (and use) the connection between the NPMLE decision and Stein unbiased risk estimator (SURE). Next, we prove that the same solution is optimal in the compound decision problem where the unobserved parameters are not assumed to be random. Similar results are usually claimed using an oracle-based argument. However, we contend that the standard oracle argument is not valid. It was only partially proved that it can be fixed, and the existing proofs of these partial results are tedious. Our approach, on the other hand, is straightforward and short.

READ FULL TEXT
research
12/06/2017

On the nonparametric maximum likelihood estimator for Gaussian location mixture densities with application to Gaussian denoising

We study the Nonparametric Maximum Likelihood Estimator (NPMLE) for esti...
research
09/03/2022

Optimal empirical Bayes estimation for the Poisson model via minimum-distance methods

The Robbins estimator is the most iconic and widely used procedure in th...
research
02/27/2019

Maximum Likelihood Estimation of Sparse Networks with Missing Observations

Estimating the matrix of connections probabilities is one of the key que...
research
09/08/2021

Multivariate, Heteroscedastic Empirical Bayes via Nonparametric Maximum Likelihood

Multivariate, heteroscedastic errors complicate statistical inference in...
research
03/06/2023

Empirical partially Bayes multiple testing and compound χ^2 decisions

We study multiple testing in the normal means problem with estimated var...
research
08/11/2023

Empirical Bayes Estimation with Side Information: A Nonparametric Integrative Tweedie Approach

We investigate the problem of compound estimation of normal means while ...
research
03/08/2023

Smoothed Analysis of Sequential Probability Assignment

We initiate the study of smoothed analysis for the sequential probabilit...

Please sign up or login with your details

Forgot password? Click here to reset