A Convex Formulation for Learning Task Relationships in Multi-Task Learning

03/15/2012
by   Yu Zhang, et al.
0

Multi-task learning is a learning paradigm which seeks to improve the generalization performance of a learning task with the help of some other related tasks. In this paper, we propose a regularization formulation for learning the relationships between tasks in multi-task learning. This formulation can be viewed as a novel generalization of the regularization framework for single-task learning. Besides modeling positive task correlation, our method, called multi-task relationship learning (MTRL), can also describe negative task correlation and identify outlier tasks based on the same underlying principle. Under this regularization framework, the objective function of MTRL is convex. For efficiency, we use an alternating method to learn the optimal model parameters for each task as well as the relationships between tasks. We study MTRL in the symmetric multi-task learning setting and then generalize it to the asymmetric setting as well. We also study the relationships between MTRL and some existing multi-task learning methods. Experiments conducted on a toy problem as well as several benchmark data sets demonstrate the effectiveness of MTRL.

READ FULL TEXT
research
11/19/2019

Adaptive Activation Network and Functional Regularization for Efficient and Flexible Deep Multi-Task Learning

Multi-task learning (MTL) is a common paradigm that seeks to improve the...
research
11/24/2020

Latent Group Structured Multi-task Learning

In multi-task learning (MTL), we improve the performance of key machine ...
research
09/27/2022

Design Perspectives of Multitask Deep Learning Models and Applications

In recent years, multi-task learning has turned out to be of great succe...
research
05/29/2019

Multi-task Learning in Deep Gaussian Processes with Multi-kernel Layers

We present a multi-task learning formulation for Deep Gaussian processes...
research
09/11/2020

Towards Interpretable Multi-Task Learning Using Bilevel Programming

Interpretable Multi-Task Learning can be expressed as learning a sparse ...
research
06/27/2012

Learning Task Grouping and Overlap in Multi-task Learning

In the paradigm of multi-task learning, mul- tiple related prediction ta...
research
06/22/2022

Multi-task twin support vector machine with Universum data

Multi-task learning (MTL) has emerged as a promising topic of machine le...

Please sign up or login with your details

Forgot password? Click here to reset