Feature-weighted elastic net: using "features of features" for better prediction

06/02/2020
by   J. Kenneth Tay, et al.
17

In some supervised learning settings, the practitioner might have additional information on the features used for prediction. We propose a new method which leverages this additional information for better prediction. The method, which we call the feature-weighted elastic net ("fwelnet"), uses these "features of features" to adapt the relative penalties on the feature coefficients in the elastic net penalty. In our simulations, fwelnet outperforms the lasso in terms of test mean squared error and usually gives an improvement in true positive rate or false positive rate for feature selection. We also apply this method to early prediction of preeclampsia, where fwelnet outperforms the lasso in terms of 10-fold cross-validated area under the curve (0.86 vs. 0.80). We also provide a connection between fwelnet and the group lasso and suggest how fwelnet might be used for multi-task learning.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/01/2018

Adaptive group-regularized logistic elastic net regression

In high-dimensional data settings, additional information on the feature...
research
04/23/2012

Sparse Prediction with the k-Support Norm

We derive a novel norm that corresponds to the tightest convex relaxatio...
research
06/06/2020

An Efficient Semi-smooth Newton Augmented Lagrangian Method for Elastic Net

Feature selection is an important and active research area in statistics...
research
07/19/2023

Lasso and elastic nets by orthants

We propose a new method for computing the lasso path, using the fact tha...
research
02/07/2020

Subsampling Winner Algorithm for Feature Selection in Large Regression Data

Feature selection from a large number of covariates (aka features) in a ...
research
11/18/2013

A Component Lasso

We propose a new sparse regression method called the component lasso, ba...
research
10/10/2018

ET-Lasso: Efficient Tuning of Lasso for High-Dimensional Data

The L1 regularization (Lasso) has proven to be a versatile tool to selec...

Please sign up or login with your details

Forgot password? Click here to reset