Estimation of the sample covariance matrix from compressive measurements

This paper focuses on the estimation of the sample covariance matrix from low-dimensional random projections of data known as compressive measurements. In particular, we present an unbiased estimator to extract the covariance structure from compressive measurements obtained by a general class of random projection matrices consisting of i.i.d. zero-mean entries and finite first four moments. In contrast to previous works, we make no structural assumptions about the underlying covariance matrix such as being low-rank. In fact, our analysis is based on a non-Bayesian data setting which requires no distributional assumptions on the set of data samples. Furthermore, inspired by the generality of the projection matrices, we propose an approach to covariance estimation that utilizes sparse Rademacher matrices. Therefore, our algorithm can be used to estimate the covariance matrix in applications with limited memory and computation power at the acquisition devices. Experimental results demonstrate that our approach allows for accurate estimation of the sample covariance matrix on several real-world data sets, including video data.

READ FULL TEXT
research
08/13/2020

Linear pooling of sample covariance matrices

We consider covariance matrix estimation in a setting, where there are m...
research
03/06/2022

Robust Estimation of Covariance Matrices: Adversarial Contamination and Beyond

We consider the problem of estimating the covariance structure of a rand...
research
10/02/2013

Exact and Stable Covariance Estimation from Quadratic Sampling via Convex Programming

Statistical inference and information processing of high-dimensional dat...
research
08/25/2022

On confidence intervals for precision matrices and the eigendecomposition of covariance matrices

The eigendecomposition of a matrix is the central procedure in probabili...
research
05/14/2019

Sample Efficient Toeplitz Covariance Estimation

We study the query complexity of estimating the covariance matrix T of a...
research
01/17/2018

Robust Modifications of U-statistics and Applications to Covariance Estimation Problems

Let Y be a d-dimensional random vector with unknown mean μ and covarianc...
research
07/23/2014

Subspace Learning From Bits

Networked sensing, where the goal is to perform complex inference using ...

Please sign up or login with your details

Forgot password? Click here to reset