High-dimensional varying index coefficient quantile regression model

09/04/2018
by   Li Jialiang, et al.
0

Statistical learning evolves quickly with more and more sophisticated models proposed to incorporate the complicated data structure from modern scientific and business problems. Varying index coefficient models extend varying coefficient models and single index models, becoming the latest state-of-the-art for semiparametric regression. This new class of models offers greater flexibility to characterize complicated nonlinear interaction effects in regression analysis. To safeguard against outliers and extreme observations, we consider a robust quantile regression approach to estimate the model parameters in this paper. High-dimensional loading parameters are allowed in our development under reasonable theoretical conditions. In addition, we propose a regularized estimation procedure to choose between linear and non-linear forms for interaction terms. We can simultaneously select significant non-zero loading parameters and identify linear functions in varying index coefficient models, in addition to estimate all the parametric and nonparametric components consistently. Under technical assumptions, we show that the proposed procedure is consistent in variable selection as well as in linear function identification, and the proposed parameter estimation enjoys the oracle property. Extensive simulation studies are carried out to assess the finite sample performance of the proposed method. We illustrate our methods with an environmental health data example.

READ FULL TEXT
research
09/22/2020

Model detection and variable selection for mode varying coefficient model

Varying coefficient model is often used in statistical modeling since it...
research
06/20/2023

The Bayesian Regularized Quantile Varying Coefficient Model

The quantile varying coefficient (VC) model can flexibly capture dynamic...
research
11/01/2020

Penalized estimation for single-index varying-coefficient models with applications to integrative genomic analysis

Recent technological advances have made it possible to collect high-dime...
research
11/06/2018

Debiased Inference of Average Partial Effects in Single-Index Models

We propose a method for average partial effect estimation in high-dimens...
research
10/19/2020

Estimating Stochastic Linear Combination of Non-linear Regressions Efficiently and Scalably

Recently, many machine learning and statistical models such as non-linea...
research
10/16/2018

High-dimensional Varying Index Coefficient Models via Stein's Identity

We study the parameter estimation problem for a single-index varying coe...
research
10/26/2021

Phase I Analysis of High-Dimensional Multivariate Processes in the Presence of Outliers

One of the significant challenges in monitoring the quality of products ...

Please sign up or login with your details

Forgot password? Click here to reset