Admissible anytime-valid sequential inference must rely on nonnegative martingales

09/07/2020
by   Aaditya Ramdas, et al.
0

Wald's anytime-valid p-values and Robbins' confidence sequences enable sequential inference for composite and nonparametric classes of distributions at arbitrary stopping times, as do more recent proposals involving Vovk's `e-values' or Shafer's `betting scores'. Examining the literature, one finds that at the heart of all these (quite different) approaches has been the identification of composite nonnegative (super)martingales. Thus, informally, nonnegative (super)martingales are known to be sufficient for valid sequential inference. Our central contribution is to show that martingales are also universal—all admissible constructions of (composite) anytime p-values, confidence sequences, or e-values must necessarily utilize nonnegative martingales (or so-called max-martingales in the case of p-values). Sufficient conditions for composite admissibility are also provided. Our proofs utilize a plethora of modern mathematical tools for composite testing and estimation problems: max-martingales, Snell envelopes, and new Doob-Lévy martingales make appearances in previously unencountered ways. Informally, if one wishes to perform anytime-valid sequential inference, then any existing approach can be recovered or dominated using martingales. We provide several sophisticated examples, with special focus on the nonparametric problem of testing if a distribution is symmetric, where our new constructions render past methods inadmissible.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/04/2022

Game-theoretic statistics and safe anytime-valid inference

Safe anytime-valid inference (SAVI) provides measures of statistical evi...
research
09/02/2020

Universal Inference with Composite Likelihoods

Wasserman et al. (2020, PNAS, vol. 117, pp. 16880-16890) constructed est...
research
05/25/2023

When do exact and powerful p-values and e-values exist?

Given a composite null 𝒫 and composite alternative 𝒬, when and how can w...
research
10/19/2022

Anytime-valid off-policy inference for contextual bandits

Contextual bandit algorithms are ubiquitous tools for active sequential ...
research
06/06/2023

Li, Li, and Dai's Contribution to the Discussion of "Estimating Means of Bounded Random Variables by Betting" by Waudby-Smith and Aaditya Ramdas

We congratulate Waudby-Smith and Ramdas for their interesting paper <cit...
research
04/03/2023

The extended Ville's inequality for nonintegrable nonnegative supermartingales

Following initial work by Robbins, we rigorously present an extended the...
research
03/16/2021

Sequential Estimation of Convex Divergences using Reverse Submartingales and Exchangeable Filtrations

We present a unified technique for sequential estimation of convex diver...

Please sign up or login with your details

Forgot password? Click here to reset