Power Calculations for Replication Studies

04/22/2020
by   Charlotte Micheloud, et al.
0

The reproducibility crisis has led to an increasing number of replication studies being conducted. Sample sizes for replication studies are often calculated using conditional power based on the effect estimate from the original study. However, this approach is not well suited as it ignores the uncertainty of the original result. Bayesian methods are often used in clinical trials to incorporate prior information into power calculations. We propose to adapt this methodology to the replication framework and to use predictive instead of conditional power. Moreover, we describe how the methodology used in sequential clinical trials can be tailored to replication studies. The predictive interim power, i.e. the predictive power conditioned on the data already collected, is shown to be useful to decide whether to stop a replication study at interim. Predictive power generally leads to smaller values than conditional power and does not always increase when increasing the sample size. Adding more subjects to the replication study can in some cases decrease the predictive power. We illustrate these properties using data from a recent project on the replicability of social sciences

READ FULL TEXT
research
11/26/2018

A New Standard for the Analysis and Design of Replication Studies

A new standard is proposed for the evidential assessment of replication ...
research
09/16/2020

The assessment of replication success based on relative effect size

Replication studies are increasingly conducted to confirm original findi...
research
04/14/2022

The replication of non-inferiority and equivalence studies

Replication studies are increasingly conducted to assess credibility of ...
research
11/04/2022

Bayesian approaches to designing replication studies

Replication studies are essential for assessing the credibility of claim...
research
11/30/2020

A proposal for informative default priors scaled by the standard error of estimates

If we have an unbiased estimate of some parameter of interest, then its ...
research
07/16/2019

Evaluating the Reproducibility of Research in Obstetrics and Gynecology

Objective: Reproducibility is a core tenet of scientific research. A rep...

Please sign up or login with your details

Forgot password? Click here to reset