DeepAI AI Chat
Log In Sign Up

Social Media Analysis for Crisis Informatics in the Cloud

by   Gerard Casas Saez, et al.

Social media analysis of disaster events is a critical task in crisis informatics research. It involves analyzing social media data generated during natural disasters, crisis events, or other mass convergence events. Due to the large data sets generated during these events, large scale software infrastructures need to be designed to analyze the data in a timely manner. Creating such infrastructures bring the need to maintain them and this becomes more difficult as these infrastructures grow larger and older. Maintenance costs are high since there is a need for queries to be handled quickly which require large amounts of computational resources to be available on demand 24 hours a day, seven days a week. In this thesis, I describe an alternative approach to designing a software infrastructure for analyzing unstructured data on the cloud while providing fast queries and with the reliability needed for crisis informatics research. Additionally, I discuss a new approach for a more reliable Twitter stream collection using container orchestrated systems. I finally compare this new infrastructure with existing crisis informatics software infrastructures and compare their reliability, scalability and extensibility with my approach and my prototype.


Social Bots and Social Media Manipulation in 2020: The Year in Review

The year 2020 will be remembered for two events of global significance: ...

Analyzing social media with crowdsourcing in Crowd4SDG

Social media have the potential to provide timely information about emer...

Reliable and Efficient Long-Term Twitter Monitoring

Social media data is now widely used by many academic researchers. Howev...

Social Media Integration of Flood Data: A Vine Copula-Based Approach

Floods are the most common and among the most severe natural disasters i...

The Pushshift Reddit Dataset

Social media data has become crucial to the advancement of scientific un...

Hadath: From Social Media Mapping to Multi-Resolution Event-Enriched Maps

Publicly available data is increasing rapidly, and will continue to grow...

Detecting Events and Patterns in Large-Scale User Generated Textual Streams with Statistical Learning Methods

A vast amount of textual web streams is influenced by events or phenomen...