When More Is Less: Pitfalls of significance testing

11/21/2022
by   Uwe Hassler, et al.
0

The controversy about statistical significance vs. scientific relevance is more than 100 years old. But still nowadays null hypothesis significance testing is considered as gold standard in many empirical fields from economics and social sciences over psychology to medicine, and small p-values are often the key to publish in journals of high scientific reputation. I highlight, illustrate and discuss potential pitfalls of statistical significance testing on three occasions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/05/2020

The Full Bayesian Significance Test and the e-value – Foundations, theory and application in the cognitive sciences

Hypothesis testing is a central statistical method in psychological rese...
research
03/01/2018

On Statistical Non-Significance

Significance tests are probably the most extended form of inference in e...
research
04/14/2022

deep-significance - Easy and Meaningful Statistical Significance Testing in the Age of Neural Networks

A lot of Machine Learning (ML) and Deep Learning (DL) research is of an ...
research
08/13/2022

Size Matters: The Use and Misuse of Statistical Significance in Discrete Choice Models in the Transportation Academic Literature

In this paper we review the academic transportation literature published...
research
06/14/2016

Time for a change: a tutorial for comparing multiple classifiers through Bayesian analysis

The machine learning community adopted the use of null hypothesis signif...
research
01/05/2018

On the Logic (plus some history and philosophy) of Statistical Tests and Scientific Investigation

Every scientific endeavour consists of (at least) two components: A hypo...
research
06/05/2023

Significance Bands for Local Projections

An impulse response function describes the dynamic evolution of an outco...

Please sign up or login with your details

Forgot password? Click here to reset