A Pliable Lasso

12/01/2017
by   Robert Tibshirani, et al.
0

We propose a generalization of the lasso that allows the model coefficients to vary as a function of a general set of modifying variables. These modifiers might be variables such as gender, age or time. The paradigm is quite general, with each lasso coefficient modified by a sparse linear function of the modifying variables Z. The model is estimated in a hierarchical fashion to control the degrees of freedom and avoid overfitting. The modifying variables may be observed, observed only in the training set, or unobserved overall. There are connections of our proposal to varying coefficient models and high-dimensional interaction models. We present a computationally efficient algorithm for its optimization, with exact screening rules to facilitate application to large numbers of predictors. The method is illustrated on a number of different simulated and real examples.

READ FULL TEXT

page 9

page 11

research
07/18/2018

A pliable lasso for the Cox model

We introduce a pliable lasso method for estimation of interaction effect...
research
05/12/2021

Look-Ahead Screening Rules for the Lasso

The lasso is a popular method to induce shrinkage and sparsity in the so...
research
05/22/2012

A lasso for hierarchical interactions

We add a set of convex constraints to the lasso to produce sparse intera...
research
02/24/2019

De-Biasing The Lasso With Degrees-of-Freedom Adjustment

This paper studies schemes to de-bias the Lasso in sparse linear regress...
research
11/28/2009

Penalized Likelihood Methods for Estimation of Sparse High Dimensional Directed Acyclic Graphs

Directed acyclic graphs (DAGs) are commonly used to represent causal rel...
research
10/13/2014

Convex Modeling of Interactions with Strong Heredity

We consider the task of fitting a regression model involving interaction...
research
11/06/2017

Independently Interpretable Lasso: A New Regularizer for Sparse Regression with Uncorrelated Variables

Sparse regularization such as ℓ_1 regularization is a quite powerful and...

Please sign up or login with your details

Forgot password? Click here to reset