Beyond Neyman-Pearson

05/02/2022
by   Peter Grünwald, et al.
0

A standard practice in statistical hypothesis testing is to mention the p-value alongside the accept/reject decision. We show the advantages of mentioning an e-value instead. With p-values, we cannot use an extreme observation (e.g. p ≪α) for getting better frequentist decisions. With e-values we can, since they provide Type-I risk control in a generalized Neyman-Pearson setting with the decision task (a general loss function) determined post-hoc, after observation of the data - thereby providing a handle on "roving α's". When Type-II risks are taken into consideration, the only admissible decision rules in the post-hoc setting turn out to be e-value-based. We also propose to replace confidence intervals and distributions by the *e-posterior*, which provides valid post-hoc frequentist uncertainty assessments irrespective of prior correctness: if the prior is chosen badly, e-intervals get wide rather than wrong, suggesting the e-posterior minimax decision rule as a safer alternative for Bayes decisions. The resulting "quasi-conditional paradigm" addresses foundational and practical issues in statistical inference.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/03/2023

The E-Posterior

We develop a representation of a decision maker's uncertainty based on e...
research
05/10/2020

Quantitative Decision Making in Pharmaceutical Development via Confidence Distributions

The Bayesian paradigm is often chosen for decision making in clinical de...
research
11/28/2014

Probability Theory without Bayes' Rule

Within the Kolmogorov theory of probability, Bayes' rule allows one to p...
research
04/24/2021

Valid Post-Detection Inference for Change Points Identified Using Trend Filtering

There are many research works and methods about change point detection i...
research
05/10/2019

Confidence intervals with maximal average power

In this paper, we propose a frequentist testing procedure that maintains...
research
10/19/2021

How to Guide Decisions with Bayes Factors

Some scientific research questions ask to guide decisions and others do ...
research
02/17/2020

Are You Sure You're Sure? – Effects of Visual Representation on the Cliff Effect in Statistical Inference

Common reporting styles of statistical results, such as confidence inter...

Please sign up or login with your details

Forgot password? Click here to reset