A Component Lasso

11/18/2013
by   Nadine Hussami, et al.
0

We propose a new sparse regression method called the component lasso, based on a simple idea. The method uses the connected-components structure of the sample covariance matrix to split the problem into smaller ones. It then solves the subproblems separately, obtaining a coefficient vector for each one. Then, it uses non-negative least squares to recombine the different vectors into a single solution. This step is useful in selecting and reweighting components that are correlated with the response. Simulated and real data examples show that the component lasso can outperform standard regression methods such as the lasso and elastic net, achieving a lower mean squared error as well as better support recovery.

READ FULL TEXT

page 10

page 15

research
02/04/2022

Elastic Gradient Descent and Elastic Gradient Flow: LARS Like Algorithms Approximating the Solution Paths of the Elastic Net

The elastic net combines lasso and ridge regression to fuse the sparsity...
research
06/11/2019

Efficient structure learning with automatic sparsity selection for causal graph processes

We propose a novel algorithm for efficiently computing a sparse directed...
research
10/10/2018

Principal component-guided sparse regression

We propose a new method for supervised learning, especially suited to wi...
research
06/02/2020

Feature-weighted elastic net: using "features of features" for better prediction

In some supervised learning settings, the practitioner might have additi...
research
07/19/2023

Lasso and elastic nets by orthants

We propose a new method for computing the lasso path, using the fact tha...
research
11/15/2015

Robust Elastic Net Regression

We propose a robust elastic net (REN) model for high-dimensional sparse ...
research
02/26/2018

DropLasso: A robust variant of Lasso for single cell RNA-seq data

Single-cell RNA sequencing (scRNA-seq) is a fast growing approach to mea...

Please sign up or login with your details

Forgot password? Click here to reset