On the Robustness of CountSketch to Adaptive Inputs

02/28/2022
by   Edith Cohen, et al.
0

CountSketch is a popular dimensionality reduction technique that maps vectors to a lower dimension using randomized linear measurements. The sketch supports recovering ℓ_2-heavy hitters of a vector (entries with v[i]^2 ≥1/kv^2_2). We study the robustness of the sketch in adaptive settings where input vectors may depend on the output from prior inputs. Adaptive settings arise in processes with feedback or with adversarial attacks. We show that the classic estimator is not robust, and can be attacked with a number of queries of the order of the sketch size. We propose a robust estimator (for a slightly modified sketch) that allows for quadratic number of queries in the sketch size, which is an improvement factor of √(k) (for k heavy hitters) over prior work.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/03/2022

Tricking the Hashing Trick: A Tight Lower Bound on the Robustness of CountSketch to Adaptive Inputs

CountSketch and Feature Hashing (the "hashing trick") are popular random...
research
05/15/2021

Adaptive Newton Sketch: Linear-time Optimization with Quadratic Convergence and Effective Hessian Dimensionality

We propose a randomized algorithm with quadratic convergence rate for co...
research
05/26/2022

Cost-efficient Gaussian Tensor Network Embeddings for Tensor-structured Inputs

This work discusses tensor network embeddings, which are random matrices...
research
04/18/2023

Optimal Eigenvalue Approximation via Sketching

Given a symmetric matrix A, we show from the simple sketch GAG^T, where ...
research
07/04/2019

Sketched MinDist

We consider sketch vectors of geometric objects J through the function ...
research
09/05/2019

Elastic_HH: Tailored Elastic for Finding Heavy Hitters

Finding heavy hitters has been of vital importance in network measuremen...
research
06/06/2023

A sketch-and-select Arnoldi process

A sketch-and-select Arnoldi process to generate a well-conditioned basis...

Please sign up or login with your details

Forgot password? Click here to reset