DeepAI AI Chat
Log In Sign Up

Feature-weighted elastic net: using "features of features" for better prediction

by   J. Kenneth Tay, et al.

In some supervised learning settings, the practitioner might have additional information on the features used for prediction. We propose a new method which leverages this additional information for better prediction. The method, which we call the feature-weighted elastic net ("fwelnet"), uses these "features of features" to adapt the relative penalties on the feature coefficients in the elastic net penalty. In our simulations, fwelnet outperforms the lasso in terms of test mean squared error and usually gives an improvement in true positive rate or false positive rate for feature selection. We also apply this method to early prediction of preeclampsia, where fwelnet outperforms the lasso in terms of 10-fold cross-validated area under the curve (0.86 vs. 0.80). We also provide a connection between fwelnet and the group lasso and suggest how fwelnet might be used for multi-task learning.


page 1

page 2

page 3

page 4


Adaptive group-regularized logistic elastic net regression

In high-dimensional data settings, additional information on the feature...

Sparse Prediction with the k-Support Norm

We derive a novel norm that corresponds to the tightest convex relaxatio...

An Efficient Semi-smooth Newton Augmented Lagrangian Method for Elastic Net

Feature selection is an important and active research area in statistics...

Subsampling Winner Algorithm for Feature Selection in Large Regression Data

Feature selection from a large number of covariates (aka features) in a ...

A Component Lasso

We propose a new sparse regression method called the component lasso, ba...

Elastic Net based Feature Ranking and Selection

Feature selection is important in data representation and intelligent di...

Precise Performance Analysis of the Box-Elastic Net under Matrix Uncertainties

In this letter, we consider the problem of recovering an unknown sparse ...

Code Repositories


Feature-weighted elastic net

view repo