Cross-Validation for Correlated Data

04/04/2019
by   Assaf Rabinowicz, et al.
0

K-fold cross-validation (CV) with squared error loss is widely used for evaluating predictive models, especially when strong distributional data assumptions cannot be taken. However, CV with squared error loss is not free from distributional assumptions, in particular in cases involving non-i.i.d data. This paper analyzes CV for correlated data. We present a criterion for suitability of CV, and introduce a bias corrected cross-validation prediction error estimator, CV_c, which is suitable in many settings involving correlated data, where CV is invalid. Our theoretical results are also demonstrated numerically.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/05/2018

Cross validation residuals for generalised least squares and other correlated data models

Cross validation residuals are well known for the ordinary least squares...
research
12/06/2021

Cross-validation for change-point regression: pitfalls and solutions

Cross-validation is the standard approach for tuning parameter selection...
research
05/28/2021

Optimality of Cross-validation in Scattered Data Approximation

Choosing models from a hypothesis space is a frequent task in approximat...
research
05/28/2020

Estimating the Prediction Performance of Spatial Models via Spatial k-Fold Cross Validation

In machine learning one often assumes the data are independent when eval...
research
03/01/2021

Statistical learning and cross-validation for point processes

This paper presents the first general (supervised) statistical learning ...
research
05/11/2022

Tuning Parameter Selection for Penalized Estimation via R2

The tuning parameter selection strategy for penalized estimation is cruc...
research
12/29/2021

Application of the Pythagorean Expected Wins Percentage and Cross-Validation Methods in Estimating Team Quality

The Pythagorean Expected Wins Percentage Model was developed by Bill Jam...

Please sign up or login with your details

Forgot password? Click here to reset