Adapting to Misspecification

05/23/2023
by   Timothy B. Armstrong, et al.
0

Empirical research typically involves a robustness-efficiency tradeoff. A researcher seeking to estimate a scalar parameter can invoke strong assumptions to motivate a restricted estimator that is precise but may be heavily biased, or they can relax some of these assumptions to motivate a more robust, but variable, unrestricted estimator. When a bound on the bias of the restricted estimator is available, it is optimal to shrink the unrestricted estimator towards the restricted estimator. For settings where a bound on the bias of the restricted estimator is unknown, we propose adaptive shrinkage estimators that minimize the percentage increase in worst case risk relative to an oracle that knows the bound. We show that adaptive estimators solve a weighted convex minimax problem and provide lookup tables facilitating their rapid computation. Revisiting five empirical studies where questions of model specification arise, we examine the advantages of adapting to – rather than testing for – misspecification.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/12/2019

Enhanced Balancing of Bias-Variance Tradeoff in Stochastic Estimation: A Minimax Perspective

Biased stochastic estimators, such as finite-differences for noisy gradi...
research
05/21/2022

Bias-robust Integration of Observational and Experimental Estimators

We describe a simple approach for combining an unbiased and a (possibly)...
research
12/29/2021

A comment and erratum on "Excess Optimism: How Biased is the Apparent Error of an Estimator Tuned by SURE?"

We identify and correct an error in the paper "Excess Optimism: How Bias...
research
10/07/2018

Error bounds for sparse classifiers in high-dimensions

We prove an L2 recovery bound for a family of sparse estimators defined ...
research
06/09/2023

Efficiency of the averaged rank-based estimator for first order Sobol index inference

Among the many estimators of first order Sobol indices that have been pr...
research
05/27/2022

Adapting to arbitrary quadratic loss via singular value shrinkage

The Gaussian sequence model is a canonical model in nonparametric estima...

Please sign up or login with your details

Forgot password? Click here to reset