Nonparametric Quantile Regression: Non-Crossing Constraints and Conformal Prediction

10/18/2022
by   Wenlu Tang, et al.
0

We propose a nonparametric quantile regression method using deep neural networks with a rectified linear unit penalty function to avoid quantile crossing. This penalty function is computationally feasible for enforcing non-crossing constraints in multi-dimensional nonparametric quantile regression. We establish non-asymptotic upper bounds for the excess risk of the proposed nonparametric quantile regression function estimators. Our error bounds achieve optimal minimax rate of convergence for the Holder class, and the prefactors of the error bounds depend polynomially on the dimension of the predictor, instead of exponentially. Based on the proposed non-crossing penalized deep quantile regression, we construct conformal prediction intervals that are fully adaptive to heterogeneity. The proposed prediction interval is shown to have good properties in terms of validity and accuracy under reasonable conditions. We also derive non-asymptotic upper bounds for the difference of the lengths between the proposed non-crossing conformal prediction interval and the theoretically oracle prediction interval. Numerical experiments including simulation studies and a real data example are conducted to demonstrate the effectiveness of the proposed method.

READ FULL TEXT
research
07/21/2022

Estimation of Non-Crossing Quantile Regression Process with Deep ReQU Neural Networks

We propose a penalized nonparametric approach to estimating the quantile...
research
06/19/2020

Sparse Quantile Regression

We consider both ℓ _0-penalized and ℓ _0-constrained quantile regression...
research
07/10/2021

Deep Quantile Regression: Mitigating the Curse of Dimensionality Through Composition

This paper considers the problem of nonparametric quantile regression un...
research
11/05/2021

Quantile index regression

Estimating the structures at high or low quantiles has become an importa...
research
11/08/2021

Solution to the Non-Monotonicity and Crossing Problems in Quantile Regression

This paper proposes a new method to address the long-standing problem of...
research
09/08/2022

Prediction intervals with controlled length in the heteroscedastic Gaussian regression

We tackle the problem of building a prediction interval in heteroscedast...
research
10/16/2020

Quantile regression with ReLU Networks: Estimators and minimax rates

Quantile regression is the task of estimating a specified percentile res...

Please sign up or login with your details

Forgot password? Click here to reset