Tuning-free one-bit covariance estimation using data-driven dithering

07/24/2023
by   Sjoerd Dirksen, et al.
0

We consider covariance estimation of any subgaussian distribution from finitely many i.i.d. samples that are quantized to one bit of information per entry. Recent work has shown that a reliable estimator can be constructed if uniformly distributed dithers on [-λ,λ] are used in the one-bit quantizer. This estimator enjoys near-minimax optimal, non-asymptotic error estimates in the operator and Frobenius norms if λ is chosen proportional to the largest variance of the distribution. However, this quantity is not known a-priori, and in practice λ needs to be carefully tuned to achieve good performance. In this work we resolve this problem by introducing a tuning-free variant of this estimator, which replaces λ by a data-driven quantity. We prove that this estimator satisfies the same non-asymptotic error estimates - up to small (logarithmic) losses and a slightly worse probability estimate. Our proof relies on a new version of the Burkholder-Rosenthal inequalities for matrix martingales, which is expected to be of independent interest.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/30/2023

A Parameter-Free Two-Bit Covariance Estimator with Improved Operator Norm Error Rate

A covariance matrix estimator using two bits per entry was recently deve...
research
04/02/2021

Covariance estimation under one-bit quantization

We consider the classical problem of estimating the covariance matrix of...
research
10/22/2020

Multivariate mean estimation with direction-dependent accuracy

We consider the problem of estimating the mean of a random vector based ...
research
11/28/2019

Finite impulse response models: A non-asymptotic analysis of the least squares estimator

We consider a finite impulse response system with centered independent s...
research
05/17/2022

Covariance Estimation: Optimal Dimension-free Guarantees for Adversarial Corruption and Heavy Tails

We provide an estimator of the covariance matrix that achieves the optim...
research
05/25/2021

On learning parametric distributions from quantized samples

We consider the problem of learning parametric distributions from their ...
research
01/31/2020

Rigorous Guarantees for Tyler's M-estimator via quantum expansion

Estimating the shape of an elliptical distribution is a fundamental prob...

Please sign up or login with your details

Forgot password? Click here to reset