Anytime-valid Confidence Intervals for Contingency Tables and Beyond

03/18/2022
by   Rosanne Turner, et al.
0

E variables are tools for designing tests that keep their type-I error guarantees under flexible sampling scenarios such as optional stopping and continuation. We extend the recently developed E variables for two-sample tests to general null hypotheses and the corresponding anytime-valid confidence sequences. Using the 2x2 contingency table (Bernoulli) setting as a running example, we provide simple implementations of these confidence sequences for linear and odds-ratio based effect size.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/04/2021

Safe Tests and Always-Valid Confidence Intervals for contingency tables and beyond

We develop E variables for testing whether two data streams come from th...
research
11/13/2020

The Safe Log Rank Test: Error Control under Optional Stopping, Continuation and Prior Misspecification

We introduce the safe log rank test, a version of the log rank test that...
research
02/20/2023

Anytime-Valid Confidence Sequences in an Enterprise A/B Testing Platform

A/B tests are the gold standard for evaluating digital experiences on th...
research
11/22/2019

Searching for new physics with profile likelihoods: Wilks and beyond

Particle physics experiments use likelihood ratio tests extensively to c...
research
10/16/2022

Anytime-Valid F-Tests for Faster Sequential Experimentation Through Covariate Adjustment

We introduce sequential F-tests and confidence sequences for subsets of ...
research
01/23/2023

Huber-Robust Confidence Sequences

Confidence sequences are confidence intervals that can be sequentially t...
research
06/09/2020

Near-Optimal Confidence Sequences for Bounded Random Variables

Many inference problems, such as sequential decision problems like A/B t...

Please sign up or login with your details

Forgot password? Click here to reset