Robust low-rank covariance matrix estimation with a general pattern of missing values

07/22/2021
by   Alexandre Hippert-Ferrer, et al.
0

This paper tackles the problem of robust covariance matrix estimation when the data is incomplete. Classical statistical estimation methodologies are usually built upon the Gaussian assumption, whereas existing robust estimation ones assume unstructured signal models. The former can be inaccurate in real-world data sets in which heterogeneity causes heavy-tail distributions, while the latter does not profit from the usual low-rank structure of the signal. Taking advantage of both worlds, a covariance matrix estimation procedure is designed on a robust (compound Gaussian) low-rank model by leveraging the observed-data likelihood function within an expectation-maximization algorithm. It is also designed to handle general pattern of missing values. The proposed procedure is first validated on simulated data sets. Then, its interest for classification and clustering applications is assessed on two real data sets with missing values, which include multispectral and hyperspectral time series.

READ FULL TEXT

page 23

page 27

research
04/07/2021

Data-fusion using factor analysis and low-rank matrix completion

Data-fusion involves the integration of multiple related datasets. The s...
research
09/27/2019

Robust Factor Analysis Parameter Estimation

This paper considers the problem of robustly estimating the parameters o...
research
06/01/2023

Robust covariance estimation with missing values and cell-wise contamination

Large datasets are often affected by cell-wise outliers in the form of m...
research
10/21/2022

Learning Graphical Factor Models with Riemannian Optimization

Graphical models and factor analysis are well-established tools in multi...
research
03/17/2021

Sparse multivariate regression with missing values and its application to the prediction of material properties

In the field of materials science and engineering, statistical analysis ...
research
06/09/2019

A Low Rank Gaussian Process Prediction Model for Very Large Datasets

Spatial prediction requires expensive computation to invert the spatial ...
research
06/25/2021

Temporal Graph Signal Decomposition

Temporal graph signals are multivariate time series with individual comp...

Please sign up or login with your details

Forgot password? Click here to reset