Learning Task Grouping and Overlap in Multi-task Learning

06/27/2012
by   Abhishek Kumar, et al.
0

In the paradigm of multi-task learning, mul- tiple related prediction tasks are learned jointly, sharing information across the tasks. We propose a framework for multi-task learn- ing that enables one to selectively share the information across the tasks. We assume that each task parameter vector is a linear combi- nation of a finite number of underlying basis tasks. The coefficients of the linear combina- tion are sparse in nature and the overlap in the sparsity patterns of two tasks controls the amount of sharing across these. Our model is based on on the assumption that task pa- rameters within a group lie in a low dimen- sional subspace but allows the tasks in differ- ent groups to overlap with each other in one or more bases. Experimental results on four datasets show that our approach outperforms competing methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/15/2012

A Convex Formulation for Learning Task Relationships in Multi-Task Learning

Multi-task learning is a learning paradigm which seeks to improve the ge...
research
05/31/2019

Modular Universal Reparameterization: Deep Multi-task Learning Across Diverse Domains

As deep learning applications continue to become more diverse, an intere...
research
12/03/2014

Curriculum Learning of Multiple Tasks

Sharing information between multiple tasks enables algorithms to achieve...
research
05/13/2017

Learning task structure via sparsity grouped multitask learning

Sparse mapping has been a key methodology in many high-dimensional scien...
research
08/23/2023

Less is More – Towards parsimonious multi-task models using structured sparsity

Group sparsity in Machine Learning (ML) encourages simpler, more interpr...
research
07/05/2023

Multi-Task Learning with Summary Statistics

Multi-task learning has emerged as a powerful machine learning paradigm ...
research
07/03/2019

Multi-Task Networks With Universe, Group, and Task Feature Learning

We present methods for multi-task learning that take advantage of natura...

Please sign up or login with your details

Forgot password? Click here to reset