DeepAI AI Chat
Log In Sign Up

On the asymptotic distribution of model averaging based on information criterion

by   Miaomiao Wang, et al.

Smoothed AIC (S-AIC) and Smoothed BIC (S-BIC) are very widely used in model averaging and are very easily to implement. Especially, the optimal model averaging method MMA and JMA have only been well developed in linear models. Only by modifying, they can be applied to other models. But S-AIC and S-BIC can be used in all situations where AIC and BIC can be calculated. In this paper, we study the asymptotic behavior of two commonly used model averaging estimators, the S-AIC and S-BIC estimators, under the standard asymptotic with general fixed parameter setup. In addition, the resulting coverage probability in Buckland et al. (1997) is not studied accurately, but it is claimed that it will be close to the intended. Our derivation make it possible to study accurately. Besides, we also prove that the confidence interval construction method in Hjort and Claeskens (2003) still works in linear regression with normal distribution error. Both the simulation and applied example support our theory conclusion.


page 1

page 2

page 3

page 4


Optimal designs for model averaging in non-nested models

In this paper we construct optimal designs for frequentist model averagi...

Distributed linear regression by averaging

Modern massive datasets pose an enormous computational burden to practit...

Nested Model Averaging on Solution Path for High-dimensional Linear Regression

We study the nested model averaging method on the solution path for a hi...

Model Averaging for Generalized Linear Model with Covariates that are Missing completely at Random

In this paper, we consider the estimation of generalized linear models w...

Confidence intervals in general regression models that utilize uncertain prior information

We consider a general regression model, without a scale parameter. Our a...

Averaging causal estimators in high dimensions

There has been increasing interest in recent years in the development of...

Provably Strict Generalisation Benefit for Equivariant Models

It is widely believed that engineering a model to be invariant/equivaria...