Transfer learning with high-dimensional quantile regression

11/26/2022
by   Jiayu Huang, et al.
0

Transfer learning has become an essential technique to exploit information from the source domain to boost performance of the target task. Despite the prevalence in high-dimensional data, heterogeneity and/or heavy tails tend to be discounted in current transfer learning approaches and thus may undermine the resulting performance. We propose a transfer learning procedure in the framework of high-dimensional quantile regression models to accommodate the heterogeneity and heavy tails in the source and target domains. We establish error bounds of the transfer learning estimator based on delicately selected transferable source domains, showing that lower error bounds can be achieved for critical selection criterion and larger sample size of source tasks. We further propose valid confidence interval and hypothesis test procedures for individual component of quantile regression coefficients by advocating a one-step debiased estimator of transfer learning estimator wherein the consistent variance estimation is proposed via the technique of transfer learning again. Simulation results demonstrate that the proposed method exhibits some favorable performances.

READ FULL TEXT

page 27

page 29

page 30

research
12/01/2022

Transfer Learning for High-dimensional Quantile Regression via Convolution Smoothing

This paper studies the high-dimensional quantile regression problem unde...
research
07/06/2021

Transfer Learning in Information Criteria-based Feature Selection

This paper investigates the effectiveness of transfer learning based on ...
research
12/13/2022

Transfer learning with quantile regression

Quantile regression is increasingly encountered in modern big data appli...
research
02/23/2022

A Class of Geometric Structures in Transfer Learning: Minimax Bounds and Optimality

We study the problem of transfer learning, observing that previous effor...
research
07/04/2020

Transfer learning of regression models from a sequence of datasets by penalized estimation

Transfer learning refers to the promising idea of initializing model fit...
research
04/12/2023

Testing Sufficiency for Transfer Learning

Modern statistical analysis often encounters high dimensional models but...
research
08/10/2022

Doubly Robust Augmented Model Accuracy Transfer Inference with High Dimensional Features

Due to label scarcity and covariate shift happening frequently in real-w...

Please sign up or login with your details

Forgot password? Click here to reset