Approximate Cross-validated Mean Estimates for Bayesian Hierarchical Regression Models

11/29/2020
by   Amy X. Zhang, et al.
0

We introduce a novel procedure for obtaining cross-validated predictive estimates for Bayesian hierarchical regression models (BHRMs). Bayesian hierarchical models are popular for their ability to model complex dependence structures and provide probabilistic uncertainty estimates, but can be computationally expensive to run. Cross-validation (CV) is therefore not a common practice to evaluate the predictive performance of BHRMs. Our method circumvents the need to re-run computationally costly estimation methods for each cross-validation fold and makes CV more feasible for large BHRMs. By conditioning on the variance-covariance parameters, we shift the CV problem from probability-based sampling to a simple and familiar optimization problem. In many cases, this produces estimates which are equivalent to full CV. We provide theoretical results and demonstrate its efficacy on publicly available data and in simulations.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/12/2021

Efficient Selection Between Hierarchical Cognitive Models: Cross-validation With Variational Bayes

Model comparison is the cornerstone of theoretical progress in psycholog...
research
11/09/2022

On High-Dimensional Gaussian Comparisons For Cross-Validation

We derive high-dimensional Gaussian comparison results for the standard ...
research
09/19/2022

Robust leave-one-out cross-validation for high-dimensional Bayesian models

Leave-one-out cross-validation (LOO-CV) is a popular method for estimati...
research
11/06/2020

Beyond Marginal Uncertainty: How Accurately can Bayesian Regression Models Estimate Posterior Predictive Correlations?

While uncertainty estimation is a well-studied topic in deep learning, m...
research
06/19/2020

Efficient implementations of echo state network cross-validation

Background/introduction: Cross-validation is still uncommon in time seri...
research
01/09/2022

Information Borrowing in Regression Models

Model development often takes data structure, subject matter considerati...

Please sign up or login with your details

Forgot password? Click here to reset