Bayesian approaches to designing replication studies

11/04/2022
by   Samuel Pawel, et al.
0

Replication studies are essential for assessing the credibility of claims from original studies. A critical aspect of designing replication studies is determining their sample size; a too small sample size may lead to inconclusive studies whereas a too large sample size may waste resources that could be allocated better in other studies. Here we show how Bayesian approaches can be used for tackling this problem. The Bayesian framework allows researchers to combine the original data and external knowledge in a design prior distribution for the underlying parameters. Based on a design prior, predictions about the replication data can be made, and the replication sample size can be chosen to ensure a sufficiently high probability of replication success. Replication success may be defined through Bayesian or non-Bayesian criteria, and different criteria may also be combined to meet distinct stakeholders and allow conclusive inferences based on multiple analysis approaches. We investigate sample size determination in the normal-normal hierarchical model where analytical results are available and traditional sample size determination is a special case where the uncertainty on parameter values is not accounted for. An application to data from a multisite replication project of social-behavioral experiments illustrates how Bayesian approaches help to design informative and cost-effective replication studies. Our methods can be used through the R package BayesRepDesign.

READ FULL TEXT
research
09/16/2020

The assessment of replication success based on relative effect size

Replication studies are increasingly conducted to confirm original findi...
research
05/06/2023

Bayesian sample size determination for multi-site replication studies

An ongoing "reproducibility crisis" calls into question scientific disco...
research
04/22/2020

Power Calculations for Replication Studies

The reproducibility crisis has led to an increasing number of replicatio...
research
01/13/2023

Designing translational animal experiments by Bayesian MAP approaches

The planning and conduct of animal experiments in the European Union is ...
research
12/09/2019

How much is optimal reinsurance degraded by error?

The literature on optimal reinsurance does not deal with how much the ef...
research
04/09/2020

Methods for Generating Typologies of Non/use

Prior studies of technology non-use demonstrate the need for approaches ...
research
07/29/2022

Power Priors for Replication Studies

The ongoing replication crisis in science has increased interest in the ...

Please sign up or login with your details

Forgot password? Click here to reset