Higher significance with smaller samples: A modified Sequential Probability Ratio Test

11/20/2018
by   Sandipan Pramanik, et al.
0

We describe a modified sequential probability ratio test that can be used to reduce the average sample size required to perform statistical hypothesis tests at specified levels of significance and power. Examples are provided for Z-tests, T-Tests, and tests of binomial success probabilities. A description of a software package to implement the tests is provided. We also compare the sample sizes required in fixed design tests conducted at 5 to the average sample sizes required in sequential tests conducted at 0.5 significance levels, and find that the two sample sizes are approximately the same. This illustrates that the proposed sequential tests can provide higher levels of significance using smaller sample sizes.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/03/2023

Inference at Scale Significance Testing for Large Search and Recommendation Experiments

A number of information retrieval studies have been done to assess which...
research
06/19/2022

3-stage and 4-stage tests with deterministic stage sizes and non-iid data

Given a fixed-sample-size test that controls the error probabilities und...
research
11/10/2022

Equivalence Test for Correlated Bivariate Binary Observation

Under the null hypothesis, the marginal probability of the positive resp...
research
02/01/2018

Macros to Conduct Tests of Multimodality in SAS

The Dip Test of Unimodality and Silverman's Critical Bandwidth Test are ...
research
01/08/2022

Evaluation of histological findings with severity grade, to analyze toxicology in-vivo studies

In-vivo toxicological studies are characterized by multiple primary endp...
research
04/06/2019

Nonparametric tests for transition probabilities in nonhomogeneous Markov processes

This paper proposes nonparametric two-sample tests for the direct compar...
research
06/07/2018

Designing Experiments to Measure Incrementality on Facebook

The importance of Facebook advertising has risen dramatically in recent ...

Please sign up or login with your details

Forgot password? Click here to reset