Adversarial Multi-task Learning for Text Classification

04/19/2017
by   Pengfei Liu, et al.
0

Neural network models have shown their promising opportunities for multi-task learning, which focus on learning the shared layers to extract the common and task-invariant features. However, in most existing approaches, the extracted shared features are prone to be contaminated by task-specific features or the noise brought by other tasks. In this paper, we propose an adversarial multi-task learning framework, alleviating the shared and private latent feature spaces from interfering with each other. We conduct extensive experiments on 16 different text classification tasks, which demonstrates the benefits of our approach. Besides, we show that the shared knowledge learned by our proposed model can be regarded as off-the-shelf knowledge and easily transferred to new tasks. The datasets of all 16 tasks are publicly available at <http://nlp.fudan.edu.cn/data/>

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/25/2018

Meta Multi-Task Learning for Sequence Modeling

Semantic composition functions have been playing a pivotal role in neura...
research
08/23/2018

Exploring Shared Structures and Hierarchies for Multiple NLP Tasks

Designing shared neural architecture plays an important role in multi-ta...
research
11/26/2018

Multi-task Learning over Graph Structures

We present two architectures for multi-task learning with neural sequenc...
research
09/19/2020

Aggressive Language Detection with Joint Text Normalization via Adversarial Multi-task Learning

Aggressive language detection (ALD), detecting the abusive and offensive...
research
04/03/2020

Context-Aware Multi-Task Learning for Traffic Scene Recognition in Autonomous Vehicles

Traffic scene recognition, which requires various visual classification ...
research
05/22/2022

All Birds with One Stone: Multi-task Text Classification for Efficient Inference with One Forward Pass

Multi-Task Learning (MTL) models have shown their robustness, effectiven...
research
07/27/2021

Exceeding the Limits of Visual-Linguistic Multi-Task Learning

By leveraging large amounts of product data collected across hundreds of...

Please sign up or login with your details

Forgot password? Click here to reset