A Case Study of Spanish Text Transformations for Twitter Sentiment Analysis

06/03/2021
by   Eric S. Tellez, et al.
16

Sentiment analysis is a text mining task that determines the polarity of a given text, i.e., its positiveness or negativeness. Recently, it has received a lot of attention given the interest in opinion mining in micro-blogging platforms. These new forms of textual expressions present new challenges to analyze text given the use of slang, orthographic and grammatical errors, among others. Along with these challenges, a practical sentiment classifier should be able to handle efficiently large workloads. The aim of this research is to identify which text transformations (lemmatization, stemming, entity removal, among others), tokenizers (e.g., words n-grams), and tokens weighting schemes impact the most the accuracy of a classifier (Support Vector Machine) trained on two Spanish corpus. The methodology used is to exhaustively analyze all the combinations of the text transformations and their respective parameters to find out which characteristics the best performing classifiers have in common. Furthermore, among the different text transformations studied, we introduce a novel approach based on the combination of word based n-grams and character based q-grams. The results show that this novel combination of words and characters produces a classifier that outperforms the traditional word based combination by 11.17% and 5.62% on the INEGI and TASS'15 dataset, respectively.

READ FULL TEXT

page 1

page 2

page 3

page 4

06/17/2018

An Improved Text Sentiment Classification Model Using TF-IDF and Next Word Negation

With the rapid growth of Text sentiment analysis, the demand for automat...
08/21/2015

Simple Text Mining for Sentiment Analysis of Political Figure Using Naive Bayes Classifier Method

Text mining can be applied to many fields. One of the application is usi...
12/15/2016

A Simple Approach to Multilingual Polarity Classification in Twitter

Recently, sentiment analysis has received a lot of attention due to the ...
10/10/2016

Supervised Term Weighting Metrics for Sentiment Analysis in Short Text

Term weighting metrics assign weights to terms in order to discriminate ...
01/20/2021

The Challenges of Persian User-generated Textual Content: A Machine Learning-Based Approach

Over recent years a lot of research papers and studies have been publish...
11/29/2018

EvoMSA: A Multilingual Evolutionary Approach for Sentiment Analysis

Sentiment analysis (SA) is a task related to understanding people's feel...
10/02/2019

Neural Word Decomposition Models for Abusive Language Detection

User generated text on social media often suffers from a lot of undesire...