A Likelihood-based Alternative to Null Hypothesis Significance Testing

06/06/2018
by   Nicholas Adams, et al.
0

The logical and practical difficulties associated with research interpretation using P values and null hypothesis significance testing have been extensively documented. This paper describes an alternative, likelihood-based approach to P-value interpretation. The P-value and sample size of a research study are used to derive a likelihood function with a single parameter, the estimated population effect size, and the method of maximum likelihood estimation is used to calculate the most likely effect size. Comparison of the likelihood of the most likely effect size and the likelihood of the minimum clinically significant effect size using the likelihood ratio test yields the clinical significance support level (or S-value), a logical and easily understood metric of research evidence. This clinical significance likelihood approach has distinct advantages over null hypothesis significance testing. As motivating examples we demonstrate the calculation and interpretation of S-values applied to two recent widely publicised trials, WOMAN from the Lancet and RELIEF from the New England Journal of Medicine.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/09/2022

When Evidence and Significance Collide

Null hypothesis statistical significance testing (NHST) is the dominant ...
research
12/06/2022

A likelihoodist trial procedure

A simple and common type of medical research involves the comparison of ...
research
08/25/2023

Assessing Keyness using Permutation Tests

We propose a resampling-based approach for assessing keyness in corpus l...
research
08/13/2021

Self-Calibrating the Look-Elsewhere Effect: Fast Evaluation of the Statistical Significance Using Peak Heights

In experiments where one searches a large parameter space for an anomaly...
research
06/04/2018

Adaptive Critical Value for Constrained Likelihood Ratio Testing

We present a new way of testing ordered hypotheses against all alternati...
research
10/19/2021

Practical Relevance: A Formal Definition

There is a general agreement that it is important to consider the practi...
research
01/31/2020

p-Value as the Strength of Evidence Measured by Confidence Distribution

The notion of p-value is a fundamental concept in statistical inference ...

Please sign up or login with your details

Forgot password? Click here to reset