fbst: An R package for the Full Bayesian Significance Test for testing a sharp null hypothesis against its alternative via the e-value

06/05/2020
by   Riko Kelter, et al.
0

Hypothesis testing is a central statistical method in psychology and the cognitive sciences. However, the problems of null hypothesis significance testing (NHST) and p-values have been debated widely, but few attractive alternatives exist. This article introduces the fbst R package, which implements the Full Bayesian Significance Test (FBST) to test a sharp null hypothesis against its alternative via the e-value. The statistical theory of the FBST has been introduced by Pereira et al. (1999) more than two decades ago and since then, the FBST has shown to be a Bayesian alternative to NHST and p-values with both theoretical and practical highly appealing properties. The algorithm provided in the fbst package is applicable to any Bayesian model as long as the posterior distribution can be obtained at least numerically. The core function of the package provides the Bayesian evidence against the null hypothesis, the e-value. Additionally, p-values based on asymptotic arguments can be computed and rich visualisations for communication and interpretation of the results can be produced. Three examples of frequently used statistical procedures in the cognitive sciences are given in this paper which demonstrate how to apply the FBST in practice using the fbst package. Based on the success of the FBST in statistical science, the fbst package should be of interest to a broad range of researchers in psychology and the cognitive sciences and hopefully will encourage researchers to consider the FBST as a possible alternative when conducting hypothesis tests of a sharp null hypothesis.

READ FULL TEXT

page 10

page 12

page 13

page 14

research
06/05/2020

The Full Bayesian Significance Test and the e-value – Foundations, theory and application in the cognitive sciences

Hypothesis testing is a central statistical method in psychological rese...
research
06/09/2022

When Evidence and Significance Collide

Null hypothesis statistical significance testing (NHST) is the dominant ...
research
01/27/2021

Bayesian Paired-Comparison with the bpcs Package

This article introduces the bpcs R package (Bayesian Paired Comparison i...
research
05/08/2020

Incentive-Compatible Critical Values

Statistical hypothesis tests are a cornerstone of scientific research. T...
research
03/27/2019

Jaccard/Tanimoto similarity test and estimation methods

Binary data are used in a broad area of biological sciences. Using binar...
research
05/16/2022

The e-value and the Full Bayesian Significance Test: Logical Properties and Philosophical Consequences

This article gives a conceptual review of the e-value, ev(H|X) – the epi...

Please sign up or login with your details

Forgot password? Click here to reset