Can Bayes Factors "Prove" the Null Hypothesis?

by   Michael Smithson, et al.

It is possible to obtain a large Bayes Factor (BF) favoring the null hypothesis when both the null and alternative hypotheses have low likelihoods, and there are other hypotheses being ignored that are much more strongly supported by the data. As sample sizes become large it becomes increasingly probable that a strong BF favouring a point null against a conventional Bayesian vague alternative co-occurs with a BF favouring various specific alternatives against the null. For any BF threshold q and sample mean, there is a value n such that sample sizes larger than n guarantee that although the BF comparing H0 against a conventional (vague) alternative exceeds q, nevertheless for some range of hypothetical μ, a BF comparing H0 against μ in that range falls below 1/q. This paper discusses the conditions under which this conundrum occurs and investigates methods for resolving it.



page 1

page 2

page 3

page 4


Bayes Factors for Peri-Null Hypotheses

A perennial objection against Bayes factor point-null hypothesis tests i...

Statistical Limits for Testing Correlation of Hypergraphs

In this paper, we consider the hypothesis testing of correlation between...

Comparison of Canonical Correlation and Partial Least Squares analyses of simulated and empirical data

In this paper, we compared the general forms of CCA and PLS on three sim...

On the error exponents of binary quantum state discrimination with composite hypotheses

We consider the asymptotic error exponents in the problem of discriminat...

On null hypotheses in survival analysis

The conventional nonparametric tests in survival analysis, such as the l...

Anytime-valid sequential testing for elicitable functionals via supermartingales

We design sequential tests for a large class of nonparametric null hypot...

Bayesian two-interval test

The null hypothesis test (NHT) is widely used for validating scientific ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.