Fast Algorithms for the Quantile Regression Process

09/12/2019
by   Victor Chernozhukov, et al.
0

The widespread use of quantile regression methods depends crucially on the existence of fast algorithms. Despite numerous algorithmic improvements, the computation time is still non-negligible because researchers often estimate many quantile regressions and use the bootstrap for inference. We suggest two new fast algorithms for the estimation of a sequence of quantile regressions at many quantile indexes. The first algorithm applies the preprocessing idea of Portnoy and Koenker (1997) but exploits a previously estimated quantile regression to guess the sign of the residuals. This step allows for a reduction of the effective sample size. The second algorithm starts from a previously estimated quantile regression at a similar quantile index and updates it using a single Newton-Raphson iteration. The first algorithm is exact, while the second is only asymptotically equivalent to the traditional quantile regression estimator. We also apply the preprocessing idea to the bootstrap by using the sample estimates to guess the sign of the residuals in the bootstrap sample. Simulations show that our new algorithms provide very large improvements in computation time without significant (if any) cost in the quality of the estimates. For instance, we divide by 100 the time required to estimate 99 quantile regressions with 20 regressors and 50,000 observations.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/01/2020

Pivotal bootstrap for quantile-based modal regression

In this paper, we develop uniform inference methods for the conditional ...
research
12/09/2020

Smoothed Quantile Regression with Large-Scale Inference

Quantile regression is a powerful tool for learning the relationship bet...
research
03/24/2019

Conservation of the t-digest Scale Invariant

A t-digest is a compact data structure that allows estimates of quantile...
research
09/29/2022

Fast Inference for Quantile Regression with Tens of Millions of Observations

While applications of big data analytics have brought many new opportuni...
research
03/20/2019

Large-Scale Online Experimentation with Quantile Metrics

Online experimentation (or A/B testing) has been widely adopted in indus...
research
08/09/2018

A Panel Quantile Approach to Attrition Bias in Big Data: Evidence from a Randomized Experiment

This paper introduces a quantile regression estimator for panel data mod...

Please sign up or login with your details

Forgot password? Click here to reset