DeepAI AI Chat
Log In Sign Up

Real-time Event Detection on Social Data Streams

by   Mateusz Fedoryszak, et al.

Social networks are quickly becoming the primary medium for discussing what is happening around real-world events. The information that is generated on social platforms like Twitter can produce rich data streams for immediate insights into ongoing matters and the conversations around them. To tackle the problem of event detection, we model events as a list of clusters of trending entities over time. We describe a real-time system for discovering events that is modular in design and novel in scale and speed: it applies clustering on a large stream with millions of entities per minute and produces a dynamically updated set of events. In order to assess clustering methodologies, we build an evaluation dataset derived from a snapshot of the full Twitter Firehose and propose novel metrics for measuring clustering quality. Through experiments and system profiling, we highlight key results from the offline and online pipelines. Finally, we visualize a high profile event on Twitter to show the importance of modeling the evolution of events, especially those detected from social data streams.


Extracting News Events from Microblogs

Twitter stream has become a large source of information for many people,...

Event-Radar: Real-time Local Event Detection System for Geo-Tagged Tweet Streams

The local event detection is to use posting messages with geotags on soc...

A Novel Approach for Detection and Ranking of Trendy and Emerging Cyber Threat Events in Twitter Streams

We present a new machine learning and text information extraction approa...

Detecting Events and Patterns in Large-Scale User Generated Textual Streams with Statistical Learning Methods

A vast amount of textual web streams is influenced by events or phenomen...

A Survey of Real-Time Social-Based Traffic Detection

Online traffic news web sites do not always announce traffic events in a...

Streaming Social Event Detection and Evolution Discovery in Heterogeneous Information Networks

Events are happening in real-world and real-time, which can be planned a...

Image Analysis Enhanced Event Detection from Geo-tagged Tweet Streams

Events detected from social media streams often include early signs of a...