On Statistical Non-Significance

03/01/2018
by   Alberto Abadie, et al.
0

Significance tests are probably the most extended form of inference in empirical research, and significance is often interpreted as providing greater informational content than non-significance. In this article we show, however, that rejection of a point null often carries very little information, while failure to reject may be highly informative. This is particularly true in empirical contexts where data sets are large and where there are rarely reasons to put substantial prior probability on a point null. Our results challenge the usual practice of conferring point null rejections a higher level of scientific significance than non-rejections. In consequence, we advocate a visible reporting and discussion of non-significant results in empirical practice.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/21/2022

When More Is Less: Pitfalls of significance testing

The controversy about statistical significance vs. scientific relevance ...
research
09/19/2021

Approximate Conditional Sampling for Pattern Detection in Weighted Networks

Assessing the statistical significance of network patterns is crucial fo...
research
10/15/2020

Distributional Null Hypothesis Testing with the T distribution

Null Hypothesis Significance Testing (NHST) has long been central to the...
research
11/04/2022

How to Tell When a Result Will Replicate: Significance and Replication in Distributional Null Hypothesis Tests

There is a well-known problem in Null Hypothesis Significance Testing: m...
research
04/14/2022

deep-significance - Easy and Meaningful Statistical Significance Testing in the Age of Neural Networks

A lot of Machine Learning (ML) and Deep Learning (DL) research is of an ...
research
08/13/2022

Size Matters: The Use and Misuse of Statistical Significance in Discrete Choice Models in the Transportation Academic Literature

In this paper we review the academic transportation literature published...
research
10/16/2020

Significance and Replication in simple counting experiments: Distributional Null Hypothesis Testing

Null Hypothesis Significance Testing (NHST) has long been of central imp...

Please sign up or login with your details

Forgot password? Click here to reset