Multitask learning over graphs

01/07/2020
by   Roula Nassif, et al.
0

The problem of learning simultaneously several related tasks has received considerable attention in several domains, especially in machine learning with the so-called multitask learning problem or learning to learn problem [1], [2]. Multitask learning is an approach to inductive transfer learning (using what is learned for one problem to assist in another problem) and helps improve generalization performance relative to learning each task separately by using the domain information contained in the training signals of related tasks as an inductive bias. Several strategies have been derived within this community under the assumption that all data are available beforehand at a fusion center. However, recent years have witnessed an increasing ability to collect data in a distributed and streaming manner. This requires the design of new strategies for learning jointly multiple tasks from streaming data over distributed (or networked) systems. This article provides an overview of multitask strategies for learning and adaptation over networks. The working hypothesis for these strategies is that agents are allowed to cooperate with each other in order to learn distinct, though related tasks. The article shows how cooperation steers the network limiting point and how different cooperation rules allow to promote different task relatedness models. It also explains how and when cooperation over multitask networks outperforms non-cooperative strategies.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/13/2017

Multitask diffusion adaptation over networks with common latent representations

Online learning with streaming data in a distributed and collaborative m...
research
08/09/2014

Bayesian Multitask Learning with Latent Hierarchies

We learn multiple hypotheses for related tasks under a latent hierarchic...
research
09/04/2012

Sparse coding for multitask and transfer learning

We investigate the use of sparse coding and dictionary learning in the c...
research
08/11/2021

MultiTask-CenterNet (MCN): Efficient and Diverse Multitask Learning using an Anchor Free Approach

Multitask learning is a common approach in machine learning, which allow...
research
03/21/2019

A Principled Approach for Learning Task Similarity in Multitask Learning

Multitask learning aims at solving a set of related tasks simultaneously...
research
04/14/2023

Exact Subspace Diffusion for Decentralized Multitask Learning

Classical paradigms for distributed learning, such as federated or decen...
research
04/28/2017

Adaptation and learning over networks for nonlinear system modeling

In this chapter, we analyze nonlinear filtering problems in distributed ...

Please sign up or login with your details

Forgot password? Click here to reset