The Full Bayesian Significance Test and the e-value – Foundations, theory and application in the cognitive sciences

06/05/2020
by   Riko Kelter, et al.
0

Hypothesis testing is a central statistical method in psychological research and the cognitive sciences. While the problems of null hypothesis significance testing (NHST) have been debated widely, few attractive alternatives exist. In this paper, we provide a tutorial on the Full Bayesian Significance Test (FBST) and the e-value, which is a fully Bayesian alternative to traditional significance tests which rely on p-values. The FBST is an advanced methodological procedure which can be applied to several areas. In this tutorial, we showcase with two examples of widely used statistical methods in psychological research how the FBST can be used in practice, provide researchers with explicit guidelines on how to conduct it and make available R-code to reproduce all results. The FBST is an innovative method which has clearly demonstrated to perform better than frequentist significance testing. However, to our best knowledge, it has not been used so far in the psychological sciences and should be of wide interest to a broad range of researchers in psychology and the cognitive sciences.

READ FULL TEXT
research
06/05/2020

fbst: An R package for the Full Bayesian Significance Test for testing a sharp null hypothesis against its alternative via the e-value

Hypothesis testing is a central statistical method in psychology and the...
research
05/27/2020

How to choose between different Bayesian posterior indices for hypothesis testing in practice

Hypothesis testing is an essential statistical method in psychology and ...
research
11/21/2022

When More Is Less: Pitfalls of significance testing

The controversy about statistical significance vs. scientific relevance ...
research
09/06/2023

Graph Theory Applications in Advanced Geospatial Research

Geospatial sciences include a wide range of applications, from environme...
research
01/28/2020

The e-value: A Fully Bayesian Significance Measure for Precise Statistical Hypotheses and its Research Program

This article gives a survey of the e-value, a statistical significance m...
research
05/08/2020

Incentive-Compatible Critical Values

Statistical hypothesis tests are a cornerstone of scientific research. T...
research
04/14/2022

deep-significance - Easy and Meaningful Statistical Significance Testing in the Age of Neural Networks

A lot of Machine Learning (ML) and Deep Learning (DL) research is of an ...

Please sign up or login with your details

Forgot password? Click here to reset