Outlier-robust Estimation of a Sparse Linear Model Using Invexity

06/22/2023
by   Adarsh Barik, et al.
0

In this paper, we study problem of estimating a sparse regression vector with correct support in the presence of outlier samples. The inconsistency of lasso-type methods is well known in this scenario. We propose a combinatorial version of outlier-robust lasso which also identifies clean samples. Subsequently, we use these clean samples to make a good estimation. We also provide a novel invex relaxation for the combinatorial problem and provide provable theoretical guarantees for this relaxation. Finally, we conduct experiments to validate our theory and compare our results against standard lasso.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/12/2019

Outlier-robust estimation of a sparse linear model using ℓ_1-penalized Huber's M-estimator

We study the problem of estimating a p-dimensional s-sparse vector in a ...
research
06/16/2020

Theory of Machine Learning Debugging via M-estimation

We investigate problems in penalized M-estimation, inspired by applicati...
research
02/19/2021

Fair Sparse Regression with Clustering: An Invex Relaxation for a Combinatorial Problem

In this paper, we study the problem of fair sparse regression on a biase...
research
05/12/2020

Robust Lasso-Zero for sparse corruption and model selection with missing covariates

We propose Robust Lasso-Zero, an extension of the Lasso-Zero methodology...
research
06/02/2022

Sparse Mixed Linear Regression with Guarantees: Taming an Intractable Problem with Invex Relaxation

In this paper, we study the problem of sparse mixed linear regression on...
research
01/02/2011

Sparse recovery with unknown variance: a LASSO-type approach

We address the issue of estimating the regression vector β in the generi...
research
09/21/2012

A Note on the SPICE Method

In this article, we analyze the SPICE method developed in [1], and estab...

Please sign up or login with your details

Forgot password? Click here to reset