CrisisLTLSum: A Benchmark for Local Crisis Event Timeline Extraction and Summarization

10/25/2022
by   Hossein Rajaby Faghihi, et al.
0

Social media has increasingly played a key role in emergency response: first responders can use public posts to better react to ongoing crisis events and deploy the necessary resources where they are most needed. Timeline extraction and abstractive summarization are critical technical tasks to leverage large numbers of social media posts about events. Unfortunately, there are few datasets for benchmarking technical approaches for those tasks. This paper presents CrisisLTLSum, the largest dataset of local crisis event timelines available to date. CrisisLTLSum contains 1,000 crisis event timelines across four domains: wildfires, local fires, traffic, and storms. We built CrisisLTLSum using a semi-automated cluster-then-refine approach to collect data from the public Twitter stream. Our initial experiments indicate a significant gap between the performance of strong baselines compared to the human performance on both tasks. Our dataset, code, and models are publicly available.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/10/2023

Using Twitter Data to Determine Hurricane Category: An Experiment

Social media posts contain an abundant amount of information about publi...
research
08/27/2022

An event detection technique using social media data

People post information about different topics which are in their active...
research
03/13/2019

Sub-event detection from Twitter streams as a sequence labeling problem

This paper introduces improved methods for sub-event detection in social...
research
01/11/2022

Incidents1M: a large-scale dataset of images with natural disasters, damage, and incidents

Natural disasters, such as floods, tornadoes, or wildfires, are increasi...
research
04/10/2020

Multimodal Categorization of Crisis Events in Social Media

Recent developments in image classification and natural language process...
research
03/03/2023

Early Warning Signals of Social Instabilities in Twitter Data

The goal of this project is to create and study novel techniques to iden...
research
07/07/2023

Subjective Crowd Disagreements for Subjective Data: Uncovering Meaningful CrowdOpinion with Population-level Learning

Human-annotated data plays a critical role in the fairness of AI systems...

Please sign up or login with your details

Forgot password? Click here to reset