Multi-task Learning over Graph Structures

11/26/2018
by   Pengfei Liu, et al.
0

We present two architectures for multi-task learning with neural sequence models. Our approach allows the relationships between different tasks to be learned dynamically, rather than using an ad-hoc pre-defined structure as in previous work. We adopt the idea from message-passing graph neural networks and propose a general graph multi-task learning framework in which different tasks can communicate with each other in an effective and interpretable way. We conduct extensive experiments in text classification and sequence labeling to evaluate our approach on multi-task learning and transfer learning. The empirical results show that our models not only outperform competitive baselines but also learn interpretable and transferable patterns across tasks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/19/2017

Adversarial Multi-task Learning for Text Classification

Neural network models have shown their promising opportunities for multi...
research
08/13/2018

Multi-Task Learning for Sequence Tagging: An Empirical Study

We study three general multi-task learning (MTL) approaches on 11 sequen...
research
02/12/2020

Deep Multi-Task Augmented Feature Learning via Hierarchical Graph Neural Network

Deep multi-task learning attracts much attention in recent years as it a...
research
09/15/2021

Learning Robot Structure and Motion Embeddings using Graph Neural Networks

We propose a learning framework to find the representation of a robot's ...
research
03/13/2017

DRAGNN: A Transition-based Framework for Dynamically Connected Neural Networks

In this work, we present a compact, modular framework for constructing n...
research
10/23/2018

Meta-Learning Multi-task Communication

In this paper, we describe a general framework: Parameters Read-Write Ne...
research
07/25/2023

When Multi-Task Learning Meets Partial Supervision: A Computer Vision Review

Multi-Task Learning (MTL) aims to learn multiple tasks simultaneously wh...

Please sign up or login with your details

Forgot password? Click here to reset