More Powerful Conditional Selective Inference for Generalized Lasso by Parametric Programming

by   Vo Nguyen Le Duy, et al.

Conditional selective inference (SI) has been studied intensively as a new statistical inference framework for data-driven hypotheses. The basic concept of conditional SI is to make the inference conditional on the selection event, which enables an exact and valid statistical inference to be conducted even when the hypothesis is selected based on the data. Conditional SI has mainly been studied in the context of model selection, such as vanilla lasso or generalized lasso. The main limitation of existing approaches is the low statistical power owing to over-conditioning, which is required for computational tractability. In this study, we propose a more powerful and general conditional SI method for a class of problems that can be converted into quadratic parametric programming, which includes generalized lasso. The key concept is to compute the continuum path of the optimal solution in the direction of the selected test statistic and to identify the subset of the data space that corresponds to the model selection event by following the solution path. The proposed parametric programming-based method not only avoids the aforementioned major drawback of over-conditioning, but also improves the performance and practicality of SI in various respects. We conducted several experiments to demonstrate the effectiveness and efficiency of our proposed method.



There are no comments yet.


page 1

page 2

page 3

page 4


More Powerful and General Selective Inference for Stepwise Feature Selection using the Homotopy Continuation Approach

Conditional Selective Inference (SI) has been actively studied as a new ...

Parametric Programming Approach for Powerful Lasso Selective Inference without Conditioning on Signs

In the past few years, Selective Inference (SI) has been actively studie...

A new procedure for Selective Inference with the Generalized Linear Lasso

This articles investigates the distribution of the solutions of the gene...

Computing Valid p-value for Optimal Changepoint by Selective Inference using Dynamic Programming

There is a vast body of literature related to methods for detecting chan...

Quantifying Statistical Significance of Neural Network Representation-Driven Hypotheses by Selective Inference

In the past few years, various approaches have been developed to explain...

Selective Inference Approach for Statistically Sound Predictive Pattern Mining

Discovering statistically significant patterns from databases is an impo...

Valid and Exact Statistical Inference for Multi-dimensional Multiple Change-Points by Selective Inference

In this paper, we study statistical inference of change-points (CPs) in ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.