Sparse coding for multitask and transfer learning

09/04/2012
by   Andreas Maurer, et al.
0

We investigate the use of sparse coding and dictionary learning in the context of multitask and transfer learning. The central assumption of our learning method is that the tasks parameters are well approximated by sparse linear combinations of the atoms of a dictionary on a high or infinite dimensional space. This assumption, together with the large quantity of available data in the multitask and transfer learning settings, allows a principled choice of the dictionary. We provide bounds on the generalization error of this approach, for both settings. Numerical experiments on one synthetic and two real datasets show the advantage of our method over single task learning, a previous method based on orthogonal and dense representation of the tasks and a related method learning task grouping.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/18/2012

On the Sample Complexity of Predictive Sparse Coding

The goal of predictive sparse coding is to learn a representation of exa...
research
05/19/2015

Multi-task additive models with shared transfer functions based on dictionary learning

Additive models form a widely popular class of regression models which r...
research
05/23/2015

The Benefit of Multitask Representation Learning

We discuss a general method to learn data representations from multiple ...
research
01/07/2020

Multitask learning over graphs

The problem of learning simultaneously several related tasks has receive...
research
08/15/2019

Multitask and Transfer Learning for Autotuning Exascale Applications

Multitask learning and transfer learning have proven to be useful in the...
research
02/08/2014

An Inequality with Applications to Structured Sparsity and Multitask Dictionary Learning

From concentration inequalities for the suprema of Gaussian or Rademache...
research
12/21/2018

An Integrated Transfer Learning and Multitask Learning Approach for Pharmacokinetic Parameter Prediction

Background: Pharmacokinetic evaluation is one of the key processes in dr...

Please sign up or login with your details

Forgot password? Click here to reset