High-Dimensional Screening Using Multiple Grouping of Variables

08/09/2012
by   Divyanshu Vats, et al.
0

Screening is the problem of finding a superset of the set of non-zero entries in an unknown p-dimensional vector β given n noisy observations. Naturally, we want this superset to be as small as possible. We propose a novel framework for screening, which we refer to as Multiple Grouping (MuG), that groups variables, performs variable selection over the groups, and repeats this process multiple number of times to estimate a sequence of sets that contains the non-zero entries in β. Screening is done by taking an intersection of all these estimated sets. The MuG framework can be used in conjunction with any group based variable selection algorithm. In the high-dimensional setting, where p >> n, we show that when MuG is used with the group Lasso estimator, screening can be consistently performed without using any tuning parameter. Our numerical simulations clearly show the merits of using the MuG framework in practice.

READ FULL TEXT
research
04/09/2007

High-dimensional variable selection

This paper explores the following question: what kind of statistical gua...
research
01/04/2022

Supervised Homogeneity Fusion: a Combinatorial Approach

Fusing regression coefficients into homogenous groups can unveil those c...
research
08/13/2022

A sequential stepwise screening procedure for sparse recovery in high-dimensional multiresponse models with complex group structures

Multiresponse data with complex group structures in both responses and p...
research
06/05/2015

High-dimensional Ordinary Least-squares Projection for Screening Variables

Variable selection is a challenging issue in statistical applications wh...
research
08/07/2020

Grouping effects of sparse CCA models in variable selection

The sparse canonical correlation analysis (SCCA) is a bi-multivariate as...
research
04/29/2012

Optimality of Graphlet Screening in High Dimensional Variable Selection

Consider a linear regression model where the design matrix X has n rows ...
research
08/23/2021

Exclusive Group Lasso for Structured Variable Selection

A structured variable selection problem is considered in which the covar...

Please sign up or login with your details

Forgot password? Click here to reset