Multitask diffusion adaptation over networks with common latent representations

02/13/2017
by   Jie Chen, et al.
0

Online learning with streaming data in a distributed and collaborative manner can be useful in a wide range of applications. This topic has been receiving considerable attention in recent years with emphasis on both single-task and multitask scenarios. In single-task adaptation, agents cooperate to track an objective of common interest, while in multitask adaptation agents track multiple objectives simultaneously. Regularization is one useful technique to promote and exploit similarity among tasks in the latter scenario. This work examines an alternative way to model relations among tasks by assuming that they all share a common latent feature representation. As a result, a new multitask learning formulation is presented and algorithms are developed for its solution in a distributed online manner. We present a unified framework to analyze the mean-square-error performance of the adaptive strategies, and conduct simulations to illustrate the theoretical findings and potential applications.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/07/2020

Multitask learning over graphs

The problem of learning simultaneously several related tasks has receive...
research
04/28/2017

Adaptation and learning over networks for nonlinear system modeling

In this chapter, we analyze nonlinear filtering problems in distributed ...
research
04/14/2023

Exact Subspace Diffusion for Decentralized Multitask Learning

Classical paradigms for distributed learning, such as federated or decen...
research
08/09/2014

Bayesian Multitask Learning with Latent Hierarchies

We learn multiple hypotheses for related tasks under a latent hierarchic...
research
05/31/2022

AdaTask: Adaptive Multitask Online Learning

We introduce and analyze AdaTask, a multitask online learning algorithm ...
research
02/21/2020

Modelling Latent Skills for Multitask Language Generation

We present a generative model for multitask conditional language generat...
research
05/22/2018

Learning over Multitask Graphs - Part II: Performance Analysis

Part I of this paper formulated a multitask optimization problem where a...

Please sign up or login with your details

Forgot password? Click here to reset