Active covariance estimation by random sub-sampling of variables

04/04/2018
by   Eduardo Pavez, et al.
0

We study covariance matrix estimation for the case of partially observed random vectors, where different samples contain different subsets of vector coordinates. Each observation is the product of the variable of interest with a 0-1 Bernoulli random variable. We analyze an unbiased covariance estimator under this model, and derive an error bound that reveals relations between the sub-sampling probabilities and the entries of the covariance matrix. We apply our analysis in an active learning framework, where the expected number of observed variables is small compared to the dimension of the vector of interest, and propose a design of optimal sub-sampling probabilities and an active covariance matrix estimation algorithm.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/12/2015

Detecting the large entries of a sparse covariance matrix in sub-quadratic time

The covariance matrix of a p-dimensional random variable is a fundamenta...
research
10/16/2019

Covariance Matrix Estimation from Correlated Sub-Gaussian Samples

This paper studies the problem of estimating a covariance matrix from co...
research
10/29/2020

Active Sampling Count Sketch (ASCS) for Online Sparse Estimation of a Trillion Scale Covariance Matrix

Estimating and storing the covariance (or correlation) matrix of high-di...
research
01/08/2020

Natural Steganography in JPEG Domain with a Linear Development Pipeline

In order to achieve high practical security, Natural Steganography (NS) ...
research
08/03/2022

Network homophily via multi-dimensional extensions of Cantelli's inequality

Homophily is the principle whereby "similarity breeds connections". We g...
research
01/10/2013

Cross-covariance modelling via DAGs with hidden variables

DAG models with hidden variables present many difficulties that are not ...
research
12/11/2019

Graph quilting: graphical model selection from partially observed covariances

We investigate the problem of conditional dependence graph estimation wh...

Please sign up or login with your details

Forgot password? Click here to reset