DeepAI AI Chat
Log In Sign Up

Adaptive Sparse Estimation with Side Information

by   Trambak Banerjee, et al.

The article considers the problem of estimating a high-dimensional sparse parameter in the presence of side information that encodes the sparsity structure. We develop a general framework that involves first using an auxiliary sequence to capture the side information, and then incorporating the auxiliary sequence in inference to reduce the estimation risk. The proposed method, which carries out adaptive SURE-thresholding using side information (ASUS), is shown to have robust performance and enjoy optimality properties. We develop new theories to characterize regimes in which ASUS far outperforms competitive shrinkage estimators, and establish precise conditions under which ASUS is asymptotically optimal. Simulation studies are conducted to show that ASUS substantially improves the performance of existing methods in many settings. The methodology is applied for analysis of data from single cell virology studies and microarray time course experiments.


page 3

page 25


Doubly Robust Inference with Non-probability Survey Samples

We establish a general framework for statistical inferences with non-pro...

Learning a high-dimensional classification rule using auxiliary outcomes

Correlated outcomes are common in many practical problems. Based on a de...

Bayesian Sparse Propensity Score Estimation for Unit Nonresponse

Nonresponse weighting adjustment using propensity score is a popular met...

Multiway sparse distance weighted discrimination

Modern data often take the form of a multiway array. However, most class...

Robust and sparse Gaussian graphical modeling under cell-wise contamination

Graphical modeling explores dependences among a collection of variables ...

Multi-level Thresholding Test for High Dimensional Covariance Matrices

We consider testing the equality of two high-dimensional covariance matr...

Transfer Learning in High-dimensional Semi-parametric Graphical Models with Application to Brain Connectivity Analysis

Transfer learning has drawn growing attention with the target of improvi...

Code Repositories


An R package for adaptive SURE thresholding with side information.

view repo