A General Framework for Empirical Bayes Estimation in Discrete Linear Exponential Family

by   Trambak Banerjee, et al.

We develop a Nonparametric Empirical Bayes (NEB) framework for compound estimation in the discrete linear exponential family, which includes a wide class of discrete distributions frequently arising from modern big data applications. We propose to directly estimate the Bayes shrinkage factor in the generalized Robbins' formula via solving a scalable convex program, which is carefully developed based on a RKHS representation of the Stein's discrepancy measure. The new NEB estimation framework is flexible for incorporating various structural constraints into the data driven rule, and provides a unified approach to compound estimation with both regular and scaled squared error losses. We develop theory to show that the class of NEB estimators enjoys strong asymptotic properties. Comprehensive simulation studies as well as analyses of real data examples are carried out to demonstrate the superiority of the NEB estimator over competing methods.



page 20


Nonparametric empirical Bayes estimation based on generalized Laguerre series

In this work, we delve into the nonparametric empirical Bayes theory and...

Bayesian Shrinkage Estimation of Negative Multinomial Parameter Vectors

The negative multinomial distribution is a multivariate generalization o...

An Empirical Bayes Method for Chi-Squared Data

In a thought-provoking paper, Efron (2011) investigated the merit and li...

Nonparametric Empirical Bayes Estimation on Heterogeneous Data

The simultaneous estimation of many parameters η_i, based on a correspon...

Revisiting Empirical Bayes Methods and Applications to Special Types of Data

Empirical Bayes methods have been around for a long time and have a wide...

A nonparametric regression approach to asymptotically optimal estimation of normal means

Simultaneous estimation of multiple parameters has received a great deal...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.