Parametric Programming Approach for Powerful Lasso Selective Inference without Conditioning on Signs

04/21/2020
by   Vo Nguyen Le Duy, et al.
0

In the past few years, Selective Inference (SI) has been actively studied for inference on the features of linear models that are adaptively selected by feature selection methods. A seminal work is proposed by Lee et al. (2016) in the case of the Lasso. The basic idea of SI is to make inference conditional on the selection event. In Lee et al. (2016), the authors proposed a tractable way to conduct inference conditional on the selected features and their signs. Unfortunately, additionally conditioning on the signs leads to low statistical power because of over-conditioning. To improve the power, a current available possible solution is to remove the conditioning on signs by considering the union of an exponentially large number of all possible sign vectors, which leads to an unrealistically large amount of computational cost unless the number of selected features is sufficiently small. To address this problem, we propose an efficient method to characterize the selection event without conditioning on signs by using parametric programming. The main idea is to compute the continuum path of Lasso solutions in the direction of a test statistic, and identify the subset of data space corresponding to the feature selection event by following the solution path. We conduct several experiments to demonstrate the effectiveness and efficiency of our proposed method.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/25/2020

More Powerful and General Selective Inference for Stepwise Feature Selection using the Homotopy Continuation Approach

Conditional Selective Inference (SI) has been actively studied as a new ...
research
05/11/2021

More Powerful Conditional Selective Inference for Generalized Lasso by Parametric Programming

Conditional selective inference (SI) has been studied intensively as a n...
research
07/21/2023

Bounded P-values in Parametric Programming-based Selective Inference

Selective inference (SI) has been actively studied as a promising framew...
research
10/14/2019

More Powerful Selective Kernel Tests for Feature Selection

Refining one's hypotheses in the light of data is a commonplace scientif...
research
02/21/2020

Computing Valid p-value for Optimal Changepoint by Selective Inference using Dynamic Programming

There is a vast body of literature related to methods for detecting chan...
research
06/24/2023

Selective inference using randomized group lasso estimators for general models

Selective inference methods are developed for group lasso estimators for...
research
06/15/2018

Crime Event Embedding with Unsupervised Feature Selection

We present a novel event embedding algorithm for crime data that can joi...

Please sign up or login with your details

Forgot password? Click here to reset