The ART of Transfer Learning: An Adaptive and Robust Pipeline

04/30/2023
by   Boxiang Wang, et al.
0

Transfer learning is an essential tool for improving the performance of primary tasks by leveraging information from auxiliary data resources. In this work, we propose Adaptive Robust Transfer Learning (ART), a flexible pipeline of performing transfer learning with generic machine learning algorithms. We establish the non-asymptotic learning theory of ART, providing a provable theoretical guarantee for achieving adaptive transfer while preventing negative transfer. Additionally, we introduce an ART-integrated-aggregating machine that produces a single final model when multiple candidate algorithms are considered. We demonstrate the promising performance of ART through extensive empirical studies on regression, classification, and sparse learning. We further present a real-data analysis for a mortality study.

READ FULL TEXT

page 1

page 15

research
01/27/2023

Feasibility and Transferability of Transfer Learning: A Mathematical Framework

Transfer learning is an emerging and popular paradigm for utilizing exis...
research
10/27/2016

Learning Bound for Parameter Transfer Learning

We consider a transfer-learning problem by using the parameter transfer ...
research
05/08/2021

Enhancing ensemble learning and transfer learning in multimodal data analysis by adaptive dimensionality reduction

Modern data analytics take advantage of ensemble learning and transfer l...
research
02/10/2022

Transfer-Learning Across Datasets with Different Input Dimensions: An Algorithm and Analysis for the Linear Regression Case

With the development of new sensors and monitoring devices, more sources...
research
07/11/2020

Transfer learning extensions for the probabilistic classification vector machine

Transfer learning is focused on the reuse of supervised learning models ...
research
03/22/2022

Locally Adaptive Transfer Learning Algorithms for Large-Scale Multiple Testing

Transfer learning has enjoyed increasing popularity in a range of big da...
research
05/31/2019

Augmenting Transfer Learning with Semantic Reasoning

Transfer learning aims at building robust prediction models by transferr...

Please sign up or login with your details

Forgot password? Click here to reset