Neural Networks for Partially Linear Quantile Regression

06/11/2021
by   Qixian Zhong, et al.
0

Deep learning has enjoyed tremendous success in a variety of applications but its application to quantile regressions remains scarce. A major advantage of the deep learning approach is its flexibility to model complex data in a more parsimonious way than nonparametric smoothing methods. However, while deep learning brought breakthroughs in prediction, it often lacks interpretability due to the black-box nature of multilayer structure with millions of parameters, hence it is not well suited for statistical inference. In this paper, we leverage the advantages of deep learning to apply it to quantile regression where the goal to produce interpretable results and perform statistical inference. We achieve this by adopting a semiparametric approach based on the partially linear quantile regression model, where covariates of primary interest for statistical inference are modelled linearly and all other covariates are modelled nonparametrically by means of a deep neural network. In addition to the new methodology, we provide theoretical justification for the proposed model by establishing the root-n consistency and asymptotically normality of the parametric coefficient estimator and the minimax optimal convergence rate of the neural nonparametric function estimator. Across several simulated and real data examples, our proposed model empirically produces superior estimates and more accurate predictions than various alternative approaches.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/09/2021

Nonparametric C- and D-vine based quantile regression

Quantile regression is a field with steadily growing importance in stati...
research
12/09/2020

Smoothed Quantile Regression with Large-Scale Inference

Quantile regression is a powerful tool for learning the relationship bet...
research
10/23/2022

Scalable estimation and inference for censored quantile regression process

Censored quantile regression (CQR) has become a valuable tool to study t...
research
07/03/2023

Engression: Extrapolation for Nonlinear Regression?

Extrapolation is crucial in many statistical and machine learning applic...
research
08/16/2022

A unifying partially-interpretable framework for neural network-based extreme quantile regression

Risk management in many environmental settings requires an understanding...
research
06/03/2019

Central Quantile Subspace

Quantile regression (QR) is becoming increasingly popular due to its rel...
research
10/20/2020

Distributed Learning of Finite Gaussian Mixtures

Advances in information technology have led to extremely large datasets ...

Please sign up or login with your details

Forgot password? Click here to reset