Doubly robust confidence sequences for sequential causal inference

by   Ian Waudby-Smith, et al.

This paper derives time-uniform confidence sequences (CS) for causal effects in experimental and observational settings. A confidence sequence for a target parameter ψ is a sequence of confidence intervals (C_t)_t=1^∞ such that every one of these intervals simultaneously captures ψ with high probability. Such CSs provide valid statistical inference for ψ at arbitrary stopping times, unlike classical fixed-time confidence intervals which require the sample size to be fixed in advance. Existing methods for constructing CSs focus on the nonasymptotic regime where certain assumptions (such as known bounds on the random variables) are imposed, while doubly-robust estimators of causal effects rely on (asymptotic) semiparametric theory. We use sequential versions of central limit theorem arguments to construct large-sample CSs for causal estimands, with a particular focus on the average treatment effect (ATE) under nonparametric conditions. These CSs allow analysts to update statistical inferences about the ATE in lieu of new data, and experiments can be continuously monitored, stopped, or continued for any data-dependent reason, all while controlling the type-I error rate. Finally, we describe how these CSs readily extend to other causal estimands and estimators, providing a new framework for sequential causal inference in a wide array of problems.



page 1

page 2

page 3

page 4


Two Robust Tools for Inference about Causal Effects with Invalid Instruments

Instrumental variables have been widely used to estimate the causal effe...

Uniform, nonparametric, non-asymptotic confidence sequences

A confidence sequence is a sequence of confidence intervals that is unif...

Locally private nonparametric confidence intervals and sequences

This work derives methods for performing nonparametric, nonasymptotic st...

Near-Optimal Confidence Sequences for Bounded Random Variables

Many inference problems, such as sequential decision problems like A/B t...

Sequential Estimation of Convex Divergences using Reverse Submartingales and Exchangeable Filtrations

We present a unified technique for sequential estimation of convex diver...

Admissible anytime-valid sequential inference must rely on nonnegative martingales

Wald's anytime-valid p-values and Robbins' confidence sequences enable s...

Mastering Panel 'Metrics: Causal Impact of Democracy on Growth

The relationship between democracy and economic growth is of long-standi...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.