Safe Sequential Testing and Effect Estimation in Stratified Count Data

02/22/2023
by   Rosanne J. Turner, et al.
0

Sequential decision making significantly speeds up research and is more cost-effective compared to fixed-n methods. We present a method for sequential decision making for stratified count data that retains Type-I error guarantee or false discovery rate under optional stopping, using e-variables. We invert the method to construct stratified anytime-valid confidence sequences, where cross-talk between subpopulations in the data can be allowed during data collection to improve power. Finally, we combine information collected in separate subpopulations through pseudo-Bayesian averaging and switching to create effective estimates for the minimal, mean and maximal treatment effects in the subpopulations.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/28/2020

Structure-Adaptive Sequential Testing for Online False Discovery Rate Control

Consider the online testing of a stream of hypotheses where a real–time ...
research
06/04/2021

Safe Tests and Always-Valid Confidence Intervals for contingency tables and beyond

We develop E variables for testing whether two data streams come from th...
research
02/27/2023

Design-Based Inference for Multi-arm Bandits

Multi-arm bandits are gaining popularity as they enable real-world seque...
research
10/16/2022

Anytime-Valid F-Tests for Faster Sequential Experimentation Through Covariate Adjustment

We introduce sequential F-tests and confidence sequences for subsets of ...
research
04/13/2020

Distributed Learning: Sequential Decision Making in Resource-Constrained Environments

We study cost-effective communication strategies that can be used to imp...
research
03/16/2021

Sequential Estimation of Convex Divergences using Reverse Submartingales and Exchangeable Filtrations

We present a unified technique for sequential estimation of convex diver...

Please sign up or login with your details

Forgot password? Click here to reset