Team Neuro at SemEval-2020 Task 8: Multi-Modal Fine Grain Emotion Classification of Memes using Multitask Learning

05/21/2020
by   Sourya Dipta Das, et al.
0

In this article, we describe the system that we used for the memotion analysis challenge, which is Task 8 of SemEval-2020. This challenge had three subtasks where affect based sentiment classification of the memes was required along with intensities. The system we proposed combines the three tasks into a single one by representing it as multi-label hierarchical classification problem.Here,Multi-Task learning or Joint learning Procedure is used to train our model.We have used dual channels to extract text and image based features from separate Deep Neural Network Backbone and aggregate them to create task specific features. These task specific aggregated feature vectors ware then passed on to smaller networks with dense layers, each one assigned for predicting one type of fine grain sentiment label. Our Proposed method show the superiority of this system in few tasks to other best models from the challenge.

READ FULL TEXT
research
01/23/2019

Sentiment and Sarcasm Classification with Multitask Learning

Sentiment classification and sarcasm detection are both important NLP ta...
research
05/14/2019

Multi-task Learning for Multi-modal Emotion Recognition and Sentiment Analysis

Related tasks often have inter-dependence on each other and perform bett...
research
09/12/2018

Emo2Vec: Learning Generalized Emotion Representation by Multi-task Training

In this paper, we propose Emo2Vec which encodes emotional semantics into...
research
06/18/2019

LTG-Oslo Hierarchical Multi-task Network: The importance of negation for document-level sentiment in Spanish

This paper details LTG-Oslo team's participation in the sentiment track ...
research
03/30/2021

Environmental sound analysis with mixup based multitask learning and cross-task fusion

Environmental sound analysis is currently getting more and more attentio...
research
07/07/2023

TBGC: Task-level Backbone-Oriented Gradient Clip for Multi-Task Foundation Model Learning

The AllInOne training paradigm squeezes a wide range of tasks into a uni...
research
07/27/2021

Exceeding the Limits of Visual-Linguistic Multi-Task Learning

By leveraging large amounts of product data collected across hundreds of...

Please sign up or login with your details

Forgot password? Click here to reset