On Transfer Learning in Functional Linear Regression

06/09/2022
by   Haotian Lin, et al.
0

This work studies the problem of transfer learning under the functional linear model framework, which aims to improve the fit of the target model by leveraging the knowledge from related source models. We measure the relatedness between target and source models using Reproducing Kernel Hilbert Spaces, allowing the type of knowledge being transferred to be interpreted by the structure of the spaces. Two algorithms are proposed: one transfers knowledge when the index of transferable sources is known, while the other one utilizes aggregation to achieve knowledge transfer without prior information about the sources. Furthermore, we establish the optimal convergence rates for excess risk, making the statistical gain via transfer learning mathematically provable. The effectiveness of the proposed algorithms is demonstrated on synthetic data as well as real financial data.

READ FULL TEXT

page 12

page 15

research
02/18/2021

Transfer Learning for Linear Regression: a Statistical Test of Gain

Transfer learning, also referred as knowledge transfer, aims at reusing ...
research
05/25/2023

Representation Transfer Learning via Multiple Pre-trained models for Linear Regression

In this paper, we consider the problem of learning a linear regression m...
research
05/29/2021

Transfer Learning under High-dimensional Generalized Linear Models

In this work, we study the transfer learning problem under high-dimensio...
research
06/18/2020

Transfer Learning for High-dimensional Linear Regression: Prediction, Estimation, and Minimax Optimality

This paper considers the estimation and prediction of a high-dimensional...
research
07/01/2023

Unified Transfer Learning Models for High-Dimensional Linear Regression

Transfer learning plays a key role in modern data analysis when: (1) the...
research
11/21/2017

Domain Generalization by Marginal Transfer Learning

Domain generalization is the problem of assigning class labels to an unl...
research
03/09/2021

Transfer Learning Can Outperform the True Prior in Double Descent Regularization

We study a fundamental transfer learning process from source to target l...

Please sign up or login with your details

Forgot password? Click here to reset