Learning Bound for Parameter Transfer Learning

10/27/2016
by   Wataru Kumagai, et al.
0

We consider a transfer-learning problem by using the parameter transfer approach, where a suitable parameter of feature mapping is learned through one task and applied to another objective task. Then, we introduce the notion of the local stability and parameter transfer learnability of parametric feature mapping,and thereby derive a learning bound for parameter transfer algorithms. As an application of parameter transfer learning, we discuss the performance of sparse coding in self-taught learning. Although self-taught learning algorithms with plentiful unlabeled data often show excellent empirical performance, their theoretical analysis has not been studied. In this paper, we also provide the first theoretical learning bound for self-taught learning.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/14/2018

Theoretical Guarantees of Transfer Learning

Transfer learning has been proven effective when within-target labeled d...
research
06/23/2018

Zeta Distribution and Transfer Learning Problem

We explore the relations between the zeta distribution and algorithmic i...
research
01/17/2022

Growing Neural Network with Shared Parameter

We propose a general method for growing neural network with shared param...
research
06/09/2015

Estimating Posterior Ratio for Classification: Transfer Learning from Probabilistic Perspective

Transfer learning assumes classifiers of similar tasks share certain par...
research
04/30/2023

The ART of Transfer Learning: An Adaptive and Robust Pipeline

Transfer learning is an essential tool for improving the performance of ...
research
11/12/2013

A PAC-Bayesian bound for Lifelong Learning

Transfer learning has received a lot of attention in the machine learnin...
research
04/11/2023

Conditional Adapters: Parameter-efficient Transfer Learning with Fast Inference

We propose Conditional Adapter (CoDA), a parameter-efficient transfer le...

Please sign up or login with your details

Forgot password? Click here to reset