Statistical significance revisited

04/01/2021
by   Maike Tormählen, et al.
0

Statistical significance measures the reliability of a result obtained from a random experiment. We investigate the number of repetitions needed for a statistical result to have a certain significance. In the first step, we consider binomially distributed variables in the example of medication testing with fixed placebo efficacy, asking how many experiments are needed in order to achieve a significance of 95 distribution of the placebo efficacy into account, which to the best of our knowledge has not been done so far. Depending on the specifics, we show that in order to obtain identical significance, it may be necessary to perform twice as many experiments than in a setting where the placebo distribution is neglected. We proceed by considering more general probability distributions and close with comments on some erroneous assumptions on probability distributions which lead, for instance, to a trivial explanation of the fat tail.

READ FULL TEXT

page 1

page 2

page 6

page 8

page 9

page 11

page 12

page 13

research
07/10/2020

A concise modification of Marshall-Olkin family of distributions for reliability analysis

The significance of Marshall-Olkin distribution in reliability theory ha...
research
05/03/2021

Multiple-Output Channel Simulation and Lossy Compression of Probability Distributions

We consider a variant of the channel simulation problem with a single in...
research
09/05/2018

Appendix - Recommended Statistical Significance Tests for NLP Tasks

Statistical significance testing plays an important role when drawing co...
research
09/19/2008

Generalized Prediction Intervals for Arbitrary Distributed High-Dimensional Data

This paper generalizes the traditional statistical concept of prediction...
research
04/14/2022

deep-significance - Easy and Meaningful Statistical Significance Testing in the Age of Neural Networks

A lot of Machine Learning (ML) and Deep Learning (DL) research is of an ...
research
05/10/2020

A machine learning based heuristic to predict the efficacy of online sale

It is difficult to decide upon the efficacy of an online sale simply fro...

Please sign up or login with your details

Forgot password? Click here to reset