On the Use of Emojis to Train Emotion Classifiers

02/24/2019
by   Wegdan Hussien, et al.
0

Nowadays, the automatic detection of emotions is employed by many applications in different fields like security informatics, e-learning, humor detection, targeted advertising, etc. Many of these applications focus on social media and treat this problem as a classification problem, which requires preparing training data. The typical method for annotating the training data by human experts is considered time consuming, labor intensive and sometimes prone to error. Moreover, such an approach is not easily extensible to new domains/languages since such extensions require annotating new training data. In this study, we propose a distant supervised learning approach where the training sentences are automatically annotated based on the emojis they have. Such training data would be very cheap to produce compared with the manually created training data, thus, much larger training data can be easily obtained. On the other hand, this training data would naturally have lower quality as it may contain some errors in the annotation. Nonetheless, we experimentally show that training classifiers on cheap, large and possibly erroneous data annotated using this approach leads to more accurate results compared with training the same classifiers on the more expensive, much smaller and error-free manually annotated training data. Our experiments are conducted on an in-house dataset of emotional Arabic tweets and the classifiers we consider are: Support Vector Machine (SVM), Multinomial Naive Bayes (MNB) and Random Forest (RF). In addition to experimenting with single classifiers, we also consider using an ensemble of classifiers. The results show that using an automatically annotated training data that is only one order of magnitude larger the manually annotated one gives better results in almost all settings considered.

READ FULL TEXT

page 10

page 11

page 12

page 13

page 15

page 16

page 17

research
02/11/2023

Emotion Detection From Social Media Posts

Over the last few years, social media has evolved into a medium for expr...
research
03/28/2023

An Experimental Study on Sentiment Classification of Moroccan dialect texts in the web

With the rapid growth of the use of social media websites, obtaining the...
research
12/13/2021

Incorporating Measurement Error in Astronomical Object Classification

Most general-purpose classification methods, such as support-vector mach...
research
02/19/2015

On the Effects of Low-Quality Training Data on Information Extraction from Clinical Reports

In the last five years there has been a flurry of work on information ex...
research
04/10/2021

Identifying and Categorizing Offensive Language in Social Media

Offensive language is pervasive in social media. Individuals frequently ...
research
05/28/2018

UG18 at SemEval-2018 Task 1: Generating Additional Training Data for Predicting Emotion Intensity in Spanish

The present study describes our submission to SemEval 2018 Task 1: Affec...
research
11/30/2020

Procode: the Swiss Multilingual Solution for Automatic Coding and Recoding of Occupations and Economic Activities

Objective. Epidemiological studies require data that are in alignment wi...

Please sign up or login with your details

Forgot password? Click here to reset