Non-Bayesian Post-Model-Selection Estimation as Estimation Under Model Misspecification

08/22/2023
by   Nadav Harel, et al.
0

In many parameter estimation problems, the exact model is unknown and is assumed to belong to a set of candidate models. In such cases, a predetermined data-based selection rule selects a parametric model from a set of candidates before the parameter estimation. The existing framework for estimation under model misspecification does not account for the selection process that led to the misspecified model. Moreover, in post-model-selection estimation, there are multiple candidate models chosen based on the observations, making the interpretation of the assumed model in the misspecified setting non-trivial. In this work, we present three interpretations to address the problem of non-Bayesian post-model-selection estimation as an estimation under model misspecification problem: the naive interpretation, the normalized interpretation, and the selective inference interpretation, and discuss their properties. For each of these interpretations, we developed the corresponding misspecified maximum likelihood estimator and the misspecified Cramér-Rao-type lower bound. The relations between the estimators and the performance bounds, as well as their properties, are discussed. Finally, we demonstrate the performance of the proposed estimators and bounds via simulations of estimation after channel selection. We show that the proposed performance bounds are more informative than the oracle Cramér-Rao Bound (CRB), where the third interpretation (selective inference) results in the lowest mean-squared-error (MSE) among the estimators.

READ FULL TEXT
research
04/15/2019

Cramer-Rao Bound for Estimation After Model Selection and its Application to Sparse Vector Estimation

In many practical parameter estimation problems, such as coefficient est...
research
02/07/2018

New Cramer-Rao-Type Bound for Constrained Parameter Estimation

Non-Bayesian parameter estimation under parametric constraints is encoun...
research
04/17/2023

Barankin-Type Bound for Constrained Parameter Estimation

In constrained parameter estimation, the classical constrained Cramer-Ra...
research
02/10/2018

A General Framework For Frequentist Model Averaging

Model selection strategies have been routinely employed to determine a m...
research
11/05/2019

Bias-aware model selection for machine learning of doubly robust functionals

While model selection is a well-studied topic in parametric and nonparam...
research
08/20/2023

An Exact Sampler for Inference after Polyhedral Model Selection

Inference after model selection presents computational challenges when d...
research
01/02/2018

Parameter estimation with a class of outer probability measures

We explore the interplay between random and deterministic phenomena usin...

Please sign up or login with your details

Forgot password? Click here to reset