Optimal empirical Bayes estimation for the Poisson model via minimum-distance methods

09/03/2022
by   Soham Jana, et al.
0

The Robbins estimator is the most iconic and widely used procedure in the empirical Bayes literature for the Poisson model. On one hand, this method has been recently shown to be minimax optimal in terms of the regret (excess risk over the Bayesian oracle that knows the true prior) for various nonparametric classes of priors. On the other hand, it has been long recognized in practice that Robbins estimator lacks the desired smoothness and monotonicity of Bayes estimators and can be easily derailed by those data points that were rarely observed before. Based on the minimum-distance distance method, we propose a suite of empirical Bayes estimators, including the classical nonparametric maximum likelihood, that outperform the Robbins method in a variety of synthetic and real data sets and retain its optimality in terms of minimax regret.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/23/2022

Empirical Bayes estimation: When does g-modeling beat f-modeling in theory (and in practice)?

Empirical Bayes (EB) is a popular framework for large-scale inference th...
research
07/05/2023

Empirical Bayes via ERM and Rademacher complexities: the Poisson model

We consider the problem of empirical Bayes estimation for (multivariate)...
research
09/20/2023

No need for an oracle: the nonparametric maximum likelihood decision in the compound decision problem is minimax

We discuss the asymptotics of the nonparametric maximum likelihood estim...
research
07/02/2015

Classical vs. Bayesian methods for linear system identification: point estimators and confidence sets

This paper compares classical parametric methods with recently developed...
research
10/05/2019

Superiority of Bayes estimators over the MLE in high dimensional multinomial models and its implication for nonparametric Bayes theory

This article focuses on the performance of Bayes estimators, in comparis...
research
09/05/2022

Bayesian nonparametric estimation of coverage probabilities and distinct counts from sketched data

The estimation of coverage probabilities, and in particular of the missi...
research
08/16/2021

Revisiting Empirical Bayes Methods and Applications to Special Types of Data

Empirical Bayes methods have been around for a long time and have a wide...

Please sign up or login with your details

Forgot password? Click here to reset