Assessing Prediction Error at Interpolation and Extrapolation Points

02/03/2018
by   Assaf Rabinowicz, et al.
0

Common model selection criteria, such as AIC and its variants, are based on in-sample prediction error estimators. However, in many applications involving predicting at interpolation and extrapolation points, in-sample error cannot be used for estimating the prediction error. In this paper new prediction error estimators, tAI and Loss(w_t) are introduced. These estimators generalize previous error estimators, however are also applicable for assessing prediction error in cases involving interpolation and extrapolation. Based on the prediction error estimators, two model selection criteria with the same spirit as AIC are suggested. The advantages of our suggested methods are demonstrated in simulation and real data analysis of studies involving interpolation and extrapolation in a Linear Mixed Model framework.

READ FULL TEXT

page 1

page 13

page 27

page 28

research
10/27/2019

An outlier-robust model averaging approach by Mallows-type criterion

Model averaging is an alternative to model selection for dealing with mo...
research
04/20/2018

Empirical-likelihood-based criteria for model selection on marginal analysis of longitudinal data with dropout missingness

Longitudinal data are common in clinical trials and observational studie...
research
04/01/2021

Model Selection for Time Series Forecasting: Empirical Analysis of Different Estimators

Evaluating predictive models is a crucial task in predictive analytics. ...
research
08/20/2021

An Adaptive Interpolation Scheme for Wideband Frequency Sweep in Electromagnetic Simulations

An adaptive interpolation scheme is proposed to accurately calculate the...
research
12/27/2020

Prediction Model Evaluation for Space-Time Data

Evaluation metrics for prediction error, model selection and model avera...
research
08/17/2023

Universal and Automatic Elbow Detection for Learning the Effective Number of Components in Model Selection Problems

We design a Universal Automatic Elbow Detector (UAED) for deciding the e...

Please sign up or login with your details

Forgot password? Click here to reset