The revisited knockoffs method for variable selection in L1-penalised regressions

07/06/2019
by   Anne Gégout-Petit, et al.
0

We consider the problem of variable selection in regression models. In particular, we are interested in selecting explanatory covariates linked with the response variable and we want to determine which covariates are relevant, that is which covariates are involved in the model. In this framework, we deal with L1-penalised regression models. To handle the choice of the penalty parameter to perform variable selection, we develop a new method based on the knockoffs idea. This revisited knockoffs method is general, suitable for a wide range of regressions with various types of response variables. Besides, it also works when the number of observations is smaller than the number of covariates and gives an order of importance of the covariates. Finally, we provide many experimental results to corroborate our method and compare it with other variable selection methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/25/2018

Penalized polytomous ordinal logistic regression using cumulative logits. Application to network inference of zero-inflated variables

We consider the problem of variable selection when the response is ordin...
research
12/16/2022

The CDF penalty:sparse and quasi unbiased estimation in regression models

In high-dimensional regression modelling, the number of candidate covari...
research
06/02/2021

On Selection of Semiparametric Spatial Regression Models

In this paper, we focus on the variable selection techniques for a class...
research
12/05/2019

Asymptotic Unbiasedness of the Permutation Importance Measure in Random Forest Models

Variable selection in sparse regression models is an important task as a...
research
03/20/2023

An ADMM approach for multi-response regression with overlapping groups and interaction effects

In this paper, we consider the regularized multi-response regression pro...
research
07/10/2022

Energy Trees: Regression and Classification With Structured and Mixed-Type Covariates

The continuous growth of data complexity requires methods and models tha...
research
07/18/2014

Extensions of stability selection using subsamples of observations and covariates

We introduce extensions of stability selection, a method to stabilise va...

Please sign up or login with your details

Forgot password? Click here to reset