Concept Drift Adaptive Physical Event Detection for Social Media Streams

09/17/2019
by   Abhijit Suprem, et al.
0

Event detection has long been the domain of physical sensors operating in a static dataset assumption. The prevalence of social media and web access has led to the emergence of social, or human sensors who report on events globally. This warrants development of event detectors that can take advantage of the truly dense and high spatial and temporal resolution data provided by more than 3 billion social users. The phenomenon of concept drift, which causes terms and signals associated with a topic to change over time, renders static machine learning ineffective. Towards this end, we present an application for physical event detection on social sensors that improves traditional physical event detection with concept drift adaptation. Our approach continuously updates its machine learning classifiers automatically, without the need for human intervention. It integrates data from heterogeneous sources and is designed to handle weak-signal events (landslides, wildfires) with around ten posts per event in addition to large-signal events (hurricanes, earthquakes) with hundreds of thousands of posts per event. We demonstrate a landslide detector on our application that detects almost 350 approaches. Our application has high performance: using classifiers trained in 2014, achieving event detection accuracy of 0.988, compared to 0.762 for static approaches.

READ FULL TEXT
research
09/17/2019

ASSED -- A Framework for Identifying Physical Events through Adaptive Social Sensor Data Filtering

Physical event detection has long been the domain of static event proces...
research
01/23/2020

EventMapper: Detecting Real-World Physical Events Using Corroborative and Probabilistic Sources

The ubiquity of social media makes it a rich source for physical event d...
research
11/21/2019

Event Detection in Noisy Streaming Data with Combination of Corroborative and Probabilistic Sources

Global physical event detection has traditionally relied on dense covera...
research
12/03/2020

Addressing machine learning concept drift reveals declining vaccine sentiment during the COVID-19 pandemic

Social media analysis has become a common approach to assess public opin...
research
02/06/2023

It's about Time: Rethinking Evaluation on Rumor Detection Benchmarks using Chronological Splits

New events emerge over time influencing the topics of rumors in social m...
research
10/14/2016

Civique: Using Social Media to Detect Urban Emergencies

We present the Civique system for emergency detection in urban areas by ...
research
07/10/2020

Reactive Soft Prototype Computing for Concept Drift Streams

The amount of real-time communication between agents in an information s...

Please sign up or login with your details

Forgot password? Click here to reset