DeepAI AI Chat
Log In Sign Up

Extracting News Events from Microblogs

by   Øystein Repp, et al.

Twitter stream has become a large source of information for many people, but the magnitude of tweets and the noisy nature of its content have made harvesting the knowledge from Twitter a challenging task for researchers for a long time. Aiming at overcoming some of the main challenges of extracting the hidden information from tweet streams, this work proposes a new approach for real-time detection of news events from the Twitter stream. We divide our approach into three steps. The first step is to use a neural network or deep learning to detect news-relevant tweets from the stream. The second step is to apply a novel streaming data clustering algorithm to the detected news tweets to form news events. The third and final step is to rank the detected events based on the size of the event clusters and growth speed of the tweet frequencies. We evaluate the proposed system on a large, publicly available corpus of annotated news events from Twitter. As part of the evaluation, we compare our approach with a related state-of-the-art solution. Overall, our experiments and user-based evaluation show that our approach on detecting current (real) news events delivers a state-of-the-art performance.


page 1

page 2

page 3

page 4


Proppy: A System to Unmask Propaganda in Online News

We present proppy, the first publicly available real-world, real-time pr...

An Event Detection Approach Based On Twitter Hashtags

Twitter is one of the most popular microblogging services in the world. ...

Real-time Event Detection on Social Data Streams

Social networks are quickly becoming the primary medium for discussing w...

Adaptive Representations for Tracking Breaking News on Twitter

Twitter is often the most up-to-date source for finding and tracking bre...

A Survey of Real-Time Social-Based Traffic Detection

Online traffic news web sites do not always announce traffic events in a...

Information flow estimation: a study of news on Twitter

News media has long been an ecosystem of creation, reproduction, and cri...

The metrics of keywords to understand the difference between Retweet and Like in each category

The purpose of this study is to clarify what kind of news is easily retw...