Smoothed Quantile Regression with Large-Scale Inference

12/09/2020
by   Xuming He, et al.
0

Quantile regression is a powerful tool for learning the relationship between a scalar response and a multivariate predictor in the presence of heavier tails and/or data heterogeneity. In the present paper, we consider statistical inference for quantile regression with large-scale data in the increasing dimension regime. We provide a comprehensive study of a convolution-type smoothing approach to achieving an adequate approximation to computation and inference for quantile regression. The ensuing estimator, which we refer to as conquer, turns the non-differentiable quantile loss function into a twice-differentiable, globally convex, and locally strongly convex surrogate, which admits a fast and scalable Barzilai-Borwein gradient-based algorithm to perform optimization, and a Rademacher multiplier bootstrap method for statistical inference. In the theoretical investigations of the conquer estimator, we establish nonasymptotic error bounds on the Bahadur-Kiefer linearization, from which we show that the asymptotic normality of the smoothed quantile regression estimator holds under a weaker requirement on the dimension of the predictors than needed for the exact quantile regression estimator. Our numerical studies confirm the conquer estimator as a practical and reliable approach to large-scale inference for quantile regression.

READ FULL TEXT
research
10/23/2022

Scalable estimation and inference for censored quantile regression process

Censored quantile regression (CQR) has become a valuable tool to study t...
research
05/21/2019

Smoothing quantile regressions

We propose to smooth the entire objective function, rather than only the...
research
09/12/2019

Fast Algorithms for the Quantile Regression Process

The widespread use of quantile regression methods depends crucially on t...
research
06/11/2021

Neural Networks for Partially Linear Quantile Regression

Deep learning has enjoyed tremendous success in a variety of application...
research
10/18/2018

Quantile Regression Under Memory Constraint

This paper studies the inference problem in quantile regression (QR) for...
research
08/22/2022

Inference for Joint Quantile and Expected Shortfall Regression

Quantiles and expected shortfalls are commonly used risk measures in fin...
research
08/09/2022

Statistical Properties of the log-cosh Loss Function Used in Machine Learning

This paper analyzes a popular loss function used in machine learning cal...

Please sign up or login with your details

Forgot password? Click here to reset