DeepAI AI Chat
Log In Sign Up

Feature-weighted elastic net: using "features of features" for better prediction

06/02/2020
by   J. Kenneth Tay, et al.
17

In some supervised learning settings, the practitioner might have additional information on the features used for prediction. We propose a new method which leverages this additional information for better prediction. The method, which we call the feature-weighted elastic net ("fwelnet"), uses these "features of features" to adapt the relative penalties on the feature coefficients in the elastic net penalty. In our simulations, fwelnet outperforms the lasso in terms of test mean squared error and usually gives an improvement in true positive rate or false positive rate for feature selection. We also apply this method to early prediction of preeclampsia, where fwelnet outperforms the lasso in terms of 10-fold cross-validated area under the curve (0.86 vs. 0.80). We also provide a connection between fwelnet and the group lasso and suggest how fwelnet might be used for multi-task learning.

READ FULL TEXT

page 1

page 2

page 3

page 4

05/01/2018

Adaptive group-regularized logistic elastic net regression

In high-dimensional data settings, additional information on the feature...
04/23/2012

Sparse Prediction with the k-Support Norm

We derive a novel norm that corresponds to the tightest convex relaxatio...
06/06/2020

An Efficient Semi-smooth Newton Augmented Lagrangian Method for Elastic Net

Feature selection is an important and active research area in statistics...
02/07/2020

Subsampling Winner Algorithm for Feature Selection in Large Regression Data

Feature selection from a large number of covariates (aka features) in a ...
11/18/2013

A Component Lasso

We propose a new sparse regression method called the component lasso, ba...
12/30/2020

Elastic Net based Feature Ranking and Selection

Feature selection is important in data representation and intelligent di...
01/11/2019

Precise Performance Analysis of the Box-Elastic Net under Matrix Uncertainties

In this letter, we consider the problem of recovering an unknown sparse ...

Code Repositories

fwelnet

Feature-weighted elastic net


view repo