Confidence intervals with maximal average power

05/10/2019
by   Christian Bartels, et al.
0

In this paper, we propose a frequentist testing procedure that maintains a defined coverage and is optimal in the sense that it gives maximal power to distinguish between hypotheses sampled from a pre-specified distribution (the prior distribution). Selecting a prior distribution allows to tune the decision rule. This leads to an increase of the power, if the true data generating distribution happens to be compatible with the prior. Similarly, it results in confidence intervals that are more precise, if the actually observed data happens to be compatible with the prior. It comes at the cost of losing power and having larger confidence intervals, if the data generating distribution or the observed data are incompatible with the prior. For constructing the testing procedure, the Bayesian posterior probability distribution is used. The proposed approach is simple to implement and does not rely on Minimax optimization. We illustrate the proposed approach for a binomial experiment, which is sufficiently simple such that the decision sets can be illustrated in figures, which should facilitate an intuitive understanding.

READ FULL TEXT
research
06/24/2022

Evidential Calibration of Confidence Intervals

We present a novel and easy to use method for calibrating error-rate bas...
research
11/16/2021

Bayesian, frequentist and fiducial intervals for the difference between two binomial proportions

Estimating the difference between two binomial proportions will be inves...
research
12/08/2019

Improved Multiple Confidence Intervals via Thresholding Informed by Prior Information

Consider a statistical problem where a set of parameters are of interest...
research
05/10/2020

Quantitative Decision Making in Pharmaceutical Development via Confidence Distributions

The Bayesian paradigm is often chosen for decision making in clinical de...
research
06/09/2020

A fiducial approach to nonparametric deconvolution problem: discrete case

Fiducial inference, as generalized by Hannig 2016 et al, is applied to n...
research
05/02/2022

Beyond Neyman-Pearson

A standard practice in statistical hypothesis testing is to mention the ...
research
09/22/2018

A default prior for regression coefficients

When the sample size is not too small, M-estimators of regression coeffi...

Please sign up or login with your details

Forgot password? Click here to reset