Size Matters: The Use and Misuse of Statistical Significance in Discrete Choice Models in the Transportation Academic Literature

08/13/2022
by   Giancarlos Parady, et al.
0

In this paper we review the academic transportation literature published between 2014 and 2018 to evaluate where the field stands regarding the use and misuse of statistical significance in empirical analysis, with a focus on discrete choice models. Our results show that 39 results exclusively based on the sign of the coefficient, 67 not distinguish statistical significance from economic, policy or scientific significance in their conclusions, and none of the reviewed studies considered the statistical power of the tests. Based on these results we put forth a set of recommendations aimed at shifting the focus away from statistical significance towards proper and comprehensive assessment of effect magnitudes and other policy relevant quantities.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/21/2022

When More Is Less: Pitfalls of significance testing

The controversy about statistical significance vs. scientific relevance ...
research
09/05/2018

Appendix - Recommended Statistical Significance Tests for NLP Tasks

Statistical significance testing plays an important role when drawing co...
research
05/03/2023

Inference at Scale Significance Testing for Large Search and Recommendation Experiments

A number of information retrieval studies have been done to assess which...
research
01/30/2019

Using Score Distributions to Compare Statistical Significance Tests for Information Retrieval Evaluation

Statistical significance tests can provide evidence that the observed di...
research
11/26/2020

NLPStatTest: A Toolkit for Comparing NLP System Performance

Statistical significance testing centered on p-values is commonly used t...
research
03/01/2018

On Statistical Non-Significance

Significance tests are probably the most extended form of inference in e...

Please sign up or login with your details

Forgot password? Click here to reset