Flagging and handling cellwise outliers by robust estimation of a covariance matrix

12/28/2019
by   Jakob Raymaekers, et al.
0

We propose a method for detecting cellwise outliers. Given a robust covariance matrix, outlying cells (entries) in a row are found by the cellFlagger technique which combines lasso regression with a stepwise application of constructed cutoff values. The L1 penalty of the lasso has a physical interpretation as the total distance that suspicious cells need to move in order to bring their row into the fold. For estimating a cellwise robust covariance matrix we construct a detection-imputation method which alternates between flagging outlying cells and updating the covariance matrix as in the EM algorithm. The proposed methods are illustrated by simulations and on real data about volatile organic compounds in children.

READ FULL TEXT
research
05/18/2012

Two New Algorithms for Solving Covariance Graphical Lasso Based on Coordinate Descent and ECM

Covariance graphical lasso applies a lasso penalty on the elements of th...
research
11/10/2018

Anomaly Detection via Graphical Lasso

Anomalies and outliers are common in real-world data, and they can arise...
research
10/12/2019

Real-time outlier detection for large datasets by RT-DetMCD

Modern industrial machines can generate gigabytes of data in seconds, fr...
research
10/24/2021

Robust Variable Selection under Cellwise Contamination

Cellwise outliers are widespread in data and traditional robust methods ...
research
12/03/2019

Decentralised Sparse Multi-Task Regression

We consider a sparse multi-task regression framework for fitting a colle...
research
08/07/2020

Outlier detection in non-elliptical data by kernel MRCD

The minimum regularized covariance determinant method (MRCD) is a robust...
research
07/03/2022

Reference-Invariant Inverse Covariance Estimation with Application to Microbial Network Recovery

The interactions between microbial taxa in microbiome data has been unde...

Please sign up or login with your details

Forgot password? Click here to reset