Leave-one-out cross-validation for non-factorizable normal models

10/24/2018
by   Paul-Christian Bürkner, et al.
0

Cross-validation can be used to measure a model's predictive accuracy for instance for the purpose of model comparison or selection. As exact cross-validation is often practically infeasible for Bayesian models because it requires too much time, approximate cross-validation methods have been developed; most notably methods for leave-one-out cross-validation (LOO-CV). However, standard LOO-CV requires the likelihood to be factorizable, that is the observations have to be conditionally independent given the model parameters. Unfortunately, some important statistical models most notably in the context of temporal and spatial statistics are non-factorizable, but LOO-CV may still be an important measure for these models. For this reason, we derive how to compute and validate exact and approximate LOO-CV for non-factorizable models that follow a multivariate normal likelihood.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/17/2019

Approximate leave-future-out cross-validation for Bayesian time series models

One of the common goals of time series analysis is to use the observed s...
research
02/16/2018

Bayesian cross-validation of geostatistical models

The problem of validating or criticising models for georeferenced data i...
research
11/01/2022

Recognition of Defective Mineral Wool Using Pruned ResNet Models

Mineral wool production is a non-linear process that makes it hard to co...
research
08/23/2019

A relation between log-likelihood and cross-validation log-scores

It is shown that the log-likelihood of a hypothesis or model given some ...
research
11/20/2020

Optimizing Approximate Leave-one-out Cross-validation to Tune Hyperparameters

For a large class of regularized models, leave-one-out cross-validation ...
research
04/05/2020

Graphical outputs and Spatial Cross-validation for the R-INLA package using INLAutils

Statistical analyses proceed by an iterative process of model fitting an...
research
06/23/2020

Approximate Cross-Validation for Structured Models

Many modern data analyses benefit from explicitly modeling dependence st...

Please sign up or login with your details

Forgot password? Click here to reset