B-Value and Empirical Equivalence Bound: A New Procedure of Hypothesis Testing

12/30/2019
by   Yi Zhao, et al.
0

In this study, we propose a two-stage procedure for hypothesis testing, where the first stage is conventional hypothesis testing and the second is an equivalence testing procedure using an introduced Empirical Equivalence Bound. In 2016, the American Statistical Association released a policy statement on P-values to clarify the proper use and interpretation in response to the criticism of reproducibility and replicability in scientific findings. A recent solution to improve reproducibility and transparency in statistical hypothesis testing is to integrate P-values (or confidence intervals) with practical or scientific significance. Similar ideas have been proposed via the equivalence test, where the goal is to infer equality under a presumption (null) of inequality of parameters. However, in these testing procedures, the definition of scientific significance/equivalence can be subjective. To circumvent this drawback, we introduce a B-value and the Empirical Equivalence Bound, which are both estimated from the data. Performing a second-stage equivalence test, our procedure offers an opportunity to correct for false positive discoveries and improve the reproducibility in findings across studies.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/22/2018

P-value: A Bless or A Curse for Evidence-Based Studies?

As a convention, p-value is often computed in frequentist hypothesis tes...
research
08/17/2023

Rethinking Hypothesis Tests

Null Hypothesis Significance Testing (NHST) have been a popular statisti...
research
07/14/2021

Comparison of Canonical Correlation and Partial Least Squares analyses of simulated and empirical data

In this paper, we compared the general forms of CCA and PLS on three sim...
research
03/07/2019

Connecting Bayes factor and the Region of Practical Equivalence (ROPE) Procedure for testing interval null hypothesis

There has been strong recent interest in testing interval null hypothesi...
research
05/09/2021

Selective Probabilistic Classifier Based on Hypothesis Testing

In this paper, we propose a simple yet effective method to deal with the...
research
01/02/2021

Visual High Dimensional Hypothesis Testing

In exploratory data analysis of known classes of high dimensional data, ...
research
09/27/2022

Hypothesis Testing for Detecting Outlier Evaluators

In epidemiological studies, very often, evaluators obtain measurements o...

Please sign up or login with your details

Forgot password? Click here to reset