A nonparametric regression approach to asymptotically optimal estimation of normal means

by   Alton Barbehenn, et al.

Simultaneous estimation of multiple parameters has received a great deal of recent interest, with applications in multiple testing, causal inference, and large-scale data analysis. Most approaches to simultaneous estimation use empirical Bayes methodology. Here we propose an alternative, completely frequentist approach based on nonparametric regression. We show that simultaneous estimation can be viewed as a constrained and penalized least-squares regression problem, so that empirical risk minimization can be used to estimate the optimal estimator within a certain class. We show that under mild conditions, our data-driven decision rules have asymptotically optimal risk that can match the best known convergence rates for this compound estimation problem. Our approach provides another perspective to understand sufficient conditions for asymptotic optimality of simultaneous estimation. Our proposed estimators demonstrate comparable performance to state-of-the-art empirical Bayes methods in a variety of simulation settings and our methodology can be extended to apply to many practically interesting settings.



page 1

page 2

page 3

page 4


Nonparametric empirical Bayes estimation based on generalized Laguerre series

In this work, we delve into the nonparametric empirical Bayes theory and...

Nonparametric Empirical Bayes Estimation on Heterogeneous Data

The simultaneous estimation of many parameters η_i, based on a correspon...

Simultaneous estimation of normal means with side information

The integrative analysis of multiple datasets is an important strategy i...

On Permutation Invariant Problems in Large-Scale Inference

Simultaneous statistical inference problems are at the basis of almost a...

Modern Subsampling Methods for Large-Scale Least Squares Regression

Subsampling methods aim to select a subsample as a surrogate for the obs...

A nonparametric empirical Bayes approach to covariance matrix estimation

We propose an empirical Bayes method to estimate high-dimensional covari...

A General Framework for Empirical Bayes Estimation in Discrete Linear Exponential Family

We develop a Nonparametric Empirical Bayes (NEB) framework for compound ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.