A sequential stepwise screening procedure for sparse recovery in high-dimensional multiresponse models with complex group structures

08/13/2022
by   Weixiong Liang, et al.
0

Multiresponse data with complex group structures in both responses and predictors arises in many fields, yet, due to the difficulty in identifying complex group structures, only a few methods have been studied on this problem. We propose a novel algorithm called sequential stepwise screening procedure (SeSS) for feature selection in high-dimensional multiresponse models with complex group structures. This algorithm encourages the grouping effect, where responses and predictors come from different groups, further, each response group is allowed to relate to multiple predictor groups. To obtain a correct model under the complex group structures, the proposed procedure first chooses the nonzero block and the nonzero row by the canonical correlation measure (CC) and then selects the nonzero entries by the extended Bayesian Information Criterion (EBIC). We show that this method is accurate in extremely sparse models and computationally attractive. The theoretical property of SeSS is established. We conduct simulation studies and consider a real example to compare its performances with existing methods.

READ FULL TEXT
research
08/10/2020

A note of feature screening via rank-based coefficient of correlation

Feature screening is useful and popular to detect informative predictors...
research
08/09/2012

High-Dimensional Screening Using Multiple Grouping of Variables

Screening is the problem of finding a superset of the set of non-zero en...
research
07/10/2017

An Interactive Greedy Approach to Group Sparsity in High Dimension

Sparsity learning with known grouping structures has received considerab...
research
05/11/2016

Interaction pursuit in high-dimensional multi-response regression via distance correlation

Feature interactions can contribute to a large proportion of variation i...
research
08/07/2020

Grouping effects of sparse CCA models in variable selection

The sparse canonical correlation analysis (SCCA) is a bi-multivariate as...
research
05/13/2017

Learning task structure via sparsity grouped multitask learning

Sparse mapping has been a key methodology in many high-dimensional scien...
research
11/28/2010

A ROAD to Classification in High Dimensional Space

For high-dimensional classification, it is well known that naively perfo...

Please sign up or login with your details

Forgot password? Click here to reset