Log In Sign Up

Frequentist performances of Bayesian prediction intervals for random-effects meta-analysis

by   Yuta Hamaguchi, et al.

The prediction interval has been increasingly used in meta-analyses as a useful measure for assessing the magnitude of treatment effect and between-studies heterogeneity. In calculations of the prediction interval, although the Higgins-Thompson-Spiegelhalter method is used most often in practice, it might not have adequate coverage probability for the true treatment effect of a future study under realistic situations. An effective alternative candidate is the Bayesian prediction interval, which has also been widely used in general prediction problems. However, these prediction intervals are constructed based on the Bayesian philosophy, and their frequentist validities are only justified by large-sample approximations even if non-informative priors are adopted. There has been no certain evidence that evaluated their frequentist performances under realistic situations of meta-analyses. In this study, we conducted extensive simulation studies to assess the frequentist coverage performances of Bayesian prediction intervals with 11 non-informative prior distributions under general meta-analysis settings. Through these simulation studies, we found that frequentist coverage performances strongly depended on what prior distributions were adopted. In addition, when the number of studies was smaller than 10, there were no prior distributions that retained accurate frequentist coverage properties. We also illustrated these methods via applications to eight real meta-analysis datasets. The resultant prediction intervals also differed according to the adopted prior distributions. Inaccurate prediction intervals may provide invalid evidence and misleading conclusions. Thus, if frequentist accuracy is required, Bayesian prediction intervals should be used cautiously in practice.


page 1

page 2

page 3

page 4


Prediction intervals for random-effects meta-analysis: a confidence distribution approach

For the inference of random-effects models in meta-analysis, the predict...

Conformal prediction intervals for the individual treatment effect

We propose several prediction intervals procedures for the individual tr...

Bayesian Model-Averaged Meta-Analysis in Medicine

We outline a Bayesian model-averaged meta-analysis for standardized mean...

Methods to Compute Prediction Intervals: A Review and New Results

This paper reviews two main types of prediction interval methods under a...

Meta-analysis of few studies involving rare events

Meta-analyses of clinical trials targeting rare events face particular c...

A Variational Inference Algorithm for BKMR in the Cross-Sectional Setting

The identification of pollutant effects is an important task in environm...

Prediction of Future Failures for Heterogeneous Reliability Field Data

This article introduces methods for constructing prediction bounds or in...