On the Value of Target Data in Transfer Learning

02/12/2020
by   Steve Hanneke, et al.
0

We aim to understand the value of additional labeled or unlabeled target data in transfer learning, for any given amount of source data; this is motivated by practical questions around minimizing sampling costs, whereby, target data is usually harder or costlier to acquire than source data, but can yield better accuracy. To this aim, we establish the first minimax-rates in terms of both source and target sample sizes, and show that performance limits are captured by new notions of discrepancy between source and target, which we refer to as transfer exponents.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/16/2020

Minimax Lower Bounds for Transfer Learning with Linear and One-hidden Layer Neural Networks

Transfer learning has emerged as a powerful technique for improving the ...
research
06/08/2021

Adaptive transfer learning

In transfer learning, we wish to make inference about a target populatio...
research
04/29/2023

Limits of Model Selection under Transfer Learning

Theoretical studies on transfer learning or domain adaptation have so fa...
research
05/28/2018

Model averaging for robust extrapolation in evidence synthesis

Extrapolation from a source to a target, e.g., from adults to children, ...
research
02/23/2022

A Class of Geometric Structures in Transfer Learning: Minimax Bounds and Optimality

We study the problem of transfer learning, observing that previous effor...
research
08/19/2019

Transfer Learning-Based Label Proportions Method with Data of Uncertainty

Learning with label proportions (LLP), which is a learning task that onl...
research
06/13/2020

Distant Transfer Learning via Deep Random Walk

Transfer learning, which is to improve the learning performance in the t...

Please sign up or login with your details

Forgot password? Click here to reset