Preparation of Improved Turkish DataSet for Sentiment Analysis in Social Media

01/30/2018
by   Semiha Makinist, et al.
0

A public dataset, with a variety of properties suitable for sentiment analysis [1], event prediction, trend detection and other text mining applications, is needed in order to be able to successfully perform analysis studies. The vast majority of data on social media is text-based and it is not possible to directly apply machine learning processes into these raw data, since several different processes are required to prepare the data before the implementation of the algorithms. For example, different misspellings of same word enlarge the word vector space unnecessarily, thereby it leads to reduce the success of the algorithm and increase the computational power requirement. This paper presents an improved Turkish dataset with an effective spelling correction algorithm based on Hadoop [2]. The collected data is recorded on the Hadoop Distributed File System and the text based data is processed by MapReduce programming model. This method is suitable for the storage and processing of large sized text based social media data. In this study, movie reviews have been automatically recorded with Apache ManifoldCF (MCF) [3] and data clusters have been created. Various methods compared such as Levenshtein and Fuzzy String Matching have been proposed to create a public dataset from collected data. Experimental results show that the proposed algorithm, which can be used as an open source dataset in sentiment analysis studies, have been performed successfully to the detection and correction of spelling errors.

READ FULL TEXT
research
11/02/2016

Towards Sub-Word Level Compositions for Sentiment Analysis of Hindi-English Code Mixed Text

Sentiment analysis (SA) using code-mixed data from social media has seve...
research
12/09/2022

Comparative Study of Sentiment Analysis for Multi-Sourced Social Media Platforms

There is a vast amount of data generated every second due to the rapidly...
research
02/14/2020

Convolutional Neural Networks for Sentiment Analysis in Persian Social Media

With the social media engagement on the rise, the resulting data can be ...
research
02/23/2019

Deep Sentiment Analysis using a Graph-based Text Representation

Social media brings about new ways of communication among people and is ...
research
01/19/2022

Small Cohort of Epilepsy Patients Showed Increased Activity on Facebook before Sudden Unexpected Death

Sudden Unexpected Death in Epilepsy (SUDEP) remains a leading cause of d...
research
01/03/2017

Fuzzy Based Implicit Sentiment Analysis on Quantitative Sentences

With the rapid growth of social media on the web, emotional polarity com...

Please sign up or login with your details

Forgot password? Click here to reset