Leave-group-out cross-validation for latent Gaussian models

10/10/2022
by   Zhedong Liu, et al.
0

Evaluating predictive performance is essential after fitting a model and leave-one-out cross-validation is a standard method. However, it is often not informative for a structured model with many possible prediction tasks. As a solution, leave-group-out cross-validation is an extension where the left-out-groups adapt to different prediction tasks. In this paper, we propose an automatic group construction procedure for leave-group-out cross-validation to estimate the predictive performance when the prediction task is not specified. We also propose an efficient approximation of leave-group-out cross-validation for latent Gaussian models. We implement both procedures in the R-INLA software.

READ FULL TEXT
research
05/05/2016

A note on adjusting R^2 for using with cross-validation

We show how to adjust the coefficient of determination (R^2) when used f...
research
01/03/2020

Leave-One-Out Cross-Validation for Bayesian Model Comparison in Large Data

Recently, new methods for model assessment, based on subsampling and pos...
research
12/23/2014

Bayesian leave-one-out cross-validation approximations for Gaussian latent variable models

The future predictive performance of a Bayesian model can be estimated u...
research
04/05/2020

Graphical outputs and Spatial Cross-validation for the R-INLA package using INLAutils

Statistical analyses proceed by an iterative process of model fitting an...
research
06/04/2018

Post model-fitting exploration via a "Next-Door" analysis

We propose a simple method for evaluating the model that has been chosen...
research
08/28/2023

Comparing AutoML and Deep Learning Methods for Condition Monitoring using Realistic Validation Scenarios

This study extensively compares conventional machine learning methods an...
research
05/24/2021

Scalable Cross Validation Losses for Gaussian Process Models

We introduce a simple and scalable method for training Gaussian process ...

Please sign up or login with your details

Forgot password? Click here to reset