DeepAI AI Chat
Log In Sign Up

Estimation of Non-Crossing Quantile Regression Process with Deep ReQU Neural Networks

by   Guohao Shen, et al.

We propose a penalized nonparametric approach to estimating the quantile regression process (QRP) in a nonseparable model using rectifier quadratic unit (ReQU) activated deep neural networks and introduce a novel penalty function to enforce non-crossing of quantile regression curves. We establish the non-asymptotic excess risk bounds for the estimated QRP and derive the mean integrated squared error for the estimated QRP under mild smoothness and regularity conditions. To establish these non-asymptotic risk and estimation error bounds, we also develop a new error bound for approximating C^s smooth functions with s >0 and their derivatives using ReQU activated neural networks. This is a new approximation result for ReQU networks and is of independent interest and may be useful in other problems. Our numerical experiments demonstrate that the proposed method is competitive with or outperforms two existing methods, including methods using reproducing kernels and random forests, for nonparametric quantile regression.


page 1

page 2

page 3

page 4


Nonparametric Quantile Regression: Non-Crossing Constraints and Conformal Prediction

We propose a nonparametric quantile regression method using deep neural ...

Quantile sheet estimator with shape constraints

A quantile sheet is a global estimator for multiple quantile curves. A q...

Deep Quantile Regression: Mitigating the Curse of Dimensionality Through Composition

This paper considers the problem of nonparametric quantile regression un...

Non asymptotic controls on a recursive superquantile approximation

In this work, we study a new recursive stochastic algorithm for the join...

Factor Model of Mixtures

This paper proposes a new approach to estimating the distribution of a r...

Learning Value-at-Risk and Expected Shortfall

We propose a non-asymptotic convergence analysis of a two-step approach ...

Learning the smoothness of noisy curves with application to online curve estimation

Combining information both within and across trajectories, we propose a ...