Multi-task Learning for Target-dependent Sentiment Classification

02/08/2019
by   Divam Gupta, et al.
0

Detecting and aggregating sentiments toward people, organizations, and events expressed in unstructured social media have become critical text mining operations. Early systems detected sentiments over whole passages, whereas more recently, target-specific sentiments have been of greater interest. In this paper, we present MTTDSC, a multi-task target-dependent sentiment classification system that is informed by feature representation learnt for the related auxiliary task of passage-level sentiment classification. The auxiliary task uses a gated recurrent unit (GRU) and pools GRU states, followed by an auxiliary fully-connected layer that outputs passage-level predictions. In the main task, these GRUs contribute auxiliary per-token representations over and above word embeddings. The main task has its own, separate GRUs. The auxiliary and main GRUs send their states to a different fully connected layer, trained for the main task. Extensive experiments using two auxiliary datasets and three benchmark datasets (of which one is new, introduced by us) for the main task demonstrate that MTTDSC outperforms state-of-the-art baselines. Using word-level sensitivity analysis, we present anecdotal evidence that prior systems can make incorrect target-specific predictions because they miss sentiments expressed by words independent of target.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/28/2018

GIRNet: Interleaved Multi-Task Recurrent State Sequence Models

In several natural language tasks, labeled sequences are available in se...
research
05/04/2017

Senti17 at SemEval-2017 Task 4: Ten Convolutional Neural Network Voters for Tweet Polarity Classification

This paper presents Senti17 system which uses ten convolutional neural n...
research
06/07/2023

Sample-Level Weighting for Multi-Task Learning with Auxiliary Tasks

Multi-task learning (MTL) can improve the generalization performance of ...
research
07/04/2018

Polarity and Intensity: the Two Aspects of Sentiment Analysis

Current multimodal sentiment analysis frames sentiment score prediction ...
research
06/18/2019

Improving Sentiment Analysis with Multi-task Learning of Negation

Sentiment analysis is directly affected by compositional phenomena in la...
research
12/05/2018

Adapting Auxiliary Losses Using Gradient Similarity

One approach to deal with the statistical inefficiency of neural network...
research
01/31/2023

Auxiliary Learning as an Asymmetric Bargaining Game

Auxiliary learning is an effective method for enhancing the generalizati...

Please sign up or login with your details

Forgot password? Click here to reset