Conformal Frequency Estimation with Sketched Data under Relaxed Exchangeability

11/09/2022
by   Matteo Sesia, et al.
0

A flexible method is developed to construct a confidence interval for the frequency of a queried object in a very large data set, based on a much smaller sketch of the data. The approach requires no knowledge of the data distribution or of the details of the sketching algorithm; instead, it constructs provably valid frequentist confidence intervals for random queries using a conformal inference approach. After achieving marginal coverage for random queries under the assumption of data exchangeability, the proposed method is extended to provide stronger inferences accounting for possibly heterogeneous frequencies of different random queries, redundant queries, and distribution shifts. While the presented methods are broadly applicable, this paper focuses on use cases involving the count-min sketch algorithm and a non-linear variation thereof, to facilitate comparison to prior work. In particular, the developed methods are compared empirically to frequentist and Bayesian alternatives, through simulations and experiments with data sets of SARS-CoV-2 DNA sequences and classic English literature.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/08/2022

Conformalized Frequency Estimation from Sketched Data

A flexible conformal inference method is developed to construct confiden...
research
09/05/2022

Bayesian nonparametric estimation of coverage probabilities and distinct counts from sketched data

The estimation of coverage probabilities, and in particular of the missi...
research
03/27/2023

Random measure priors in Bayesian frequency recovery from sketches

Given a lossy-compressed representation, or sketch, of data with values ...
research
08/14/2022

Sharp Frequency Bounds for Sample-Based Queries

A data sketch algorithm scans a big data set, collecting a small amount ...
research
06/24/2020

Approximating a Target Distribution using Weight Queries

A basic assumption in classical learning and estimation is the availabil...
research
04/10/2019

Practical Valid Inferences for the Two-Sample Binomial Problem

Consider comparing two independent binomial responses. Our interest is w...
research
06/06/2023

Statistical inference for sketching algorithms

Sketching algorithms use random projections to generate a smaller sketch...

Please sign up or login with your details

Forgot password? Click here to reset