DeepAI AI Chat
Log In Sign Up

Real Time Sentiment Change Detection of Twitter Data Streams

by   Sotiris K. Tasoulis, et al.

In the past few years, there has been a huge growth in Twitter sentiment analysis having already provided a fair amount of research on sentiment detection of public opinion among Twitter users. Given the fact that Twitter messages are generated constantly with dizzying rates, a huge volume of streaming data is created, thus there is an imperative need for accurate methods for knowledge discovery and mining of this information. Although there exists a plethora of twitter sentiment analysis methods in the recent literature, the researchers have shifted to real-time sentiment identification on twitter streaming data, as expected. A major challenge is to deal with the Big Data challenges arising in Twitter streaming applications concerning both Volume and Velocity. Under this perspective, in this paper, a methodological approach based on open source tools is provided for real-time detection of changes in sentiment that is ultra efficient with respect to both memory consumption and computational cost. This is achieved by iteratively collecting tweets in real time and discarding them immediately after their process. For this purpose, we employ the Lexicon approach for sentiment characterizations, while change detection is achieved through appropriate control charts that do not require historical information. We believe that the proposed methodology provides the trigger for a potential large-scale monitoring of threads in an attempt to discover fake news spread or propaganda efforts in their early stages. Our experimental real-time analysis based on a recent hashtag provides evidence that the proposed approach can detect meaningful sentiment changes across a hashtags lifetime.


page 1

page 2

page 3

page 4


Approaches for Sentiment Analysis on Twitter: A State-of-Art study

Microbloging is an extremely prevalent broadcast medium amidst the Inter...

Real-time Text Analytics Pipeline Using Open-source Big Data Tools

Real-time text processing systems are required in many domains to quickl...

Using Hadoop for Large Scale Analysis on Twitter: A Technical Report

Sentiment analysis (or opinion mining) on Twitter data has attracted muc...

TrollHunter2020: Real-Time Detection of Trolling Narratives on Twitter During the 2020 US Elections

This paper presents TrollHunter2020, a real-time detection mechanism we ...

SemEval-2013 Task 2: Sentiment Analysis in Twitter

In recent years, sentiment analysis in social media has attracted a lot ...

Mining Public Opinion on Twitter about Natural Disaster Response Using Machine Learning Techniques

With the development of the Internet, social media has become an essenti...