Copula-based Partial Correlation Screening: a Joint and Robust Approach

02/05/2018
by   Jialiang Li, et al.
0

Screening for ultrahigh dimensional features may encounter complicated issues such as outlying observations, heteroscedasticity or heavy-tailed distribution, multi-collinearity and confounding effects. Standard correlation-based marginal screening methods may be a weak solution to these issues. We contribute a novel robust joint screener to safeguard against outliers and distribution mis-specification for both the response variable and the covariates, and to account for external variables at the screening step. Specifically, we introduce a copula-based partial correlation (CPC) screener. We show that the empirical process of the estimated CPC converges weakly to a Gaussian process and establish the sure screening property for CPC screener under very mild technical conditions, where we need not require any moment condition, weaker than existing alternatives in the literature. Moreover, our approach allows for a diverging number of conditional variables from the theoretical point of view. Extensive simulation studies and two data applications are included to illustrate our proposal.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/24/2021

A Robust Partial Correlation-based Screening Approach

As a computationally fast and working efficient tool, sure independence ...
research
10/07/2021

Distribution-free and Model-free Multivariate Feature Screening via Multivariate Rank Distance Correlation

Feature screening approaches are effective in selecting active features ...
research
04/10/2018

Model-Free Conditional Feature Screening with Exposure Variables

In high dimensional analysis, effects of explanatory variables on respon...
research
12/26/2022

Robust distance correlation for variable screening

High-dimensional data are commonly seen in modern statistical applicatio...
research
02/06/2011

Large Scale Correlation Screening

This paper treats the problem of screening for variables with high corre...
research
08/21/2017

ExSIS: Extended Sure Independence Screening for Ultrahigh-dimensional Linear Models

Statistical inference can be computationally prohibitive in ultrahigh-di...
research
08/29/2019

Variable screening based on Gaussian Centered L-moments

An important challenge in big data is identification of important variab...

Please sign up or login with your details

Forgot password? Click here to reset