Social Media Images Classification Models for Real-time Disaster Response

04/09/2021
by   Firoj Alam, et al.
0

Images shared on social media help crisis managers in terms of gaining situational awareness and assessing incurred damages, among other response tasks. As the volume and velocity of such content are really high, therefore, real-time image classification became an urgent need in order to take a faster response. Recent advances in computer vision and deep neural networks have enabled the development of models for real-time image classification for a number of tasks, including detecting crisis incidents, filtering irrelevant images, classifying images into specific humanitarian categories, and assessing the severity of the damage. For developing real-time robust models, it is necessary to understand the capability of the publicly available pretrained models for these tasks. In the current state-of-art of crisis informatics, it is under-explored. In this study, we address such limitations. We investigate ten different architectures for four different tasks using the largest publicly available datasets for these tasks. We also explore the data augmentation, semi-supervised techniques, and a multitask setup. In our extensive experiments, we achieve promising results.

READ FULL TEXT

page 3

page 8

page 30

page 31

research
11/17/2020

Deep Learning Benchmarks and Datasets for Social Media Image Classification for Disaster Response

During a disaster event, images shared on social media helps crisis mana...
research
04/09/2017

Automatic Image Filtering on Social Networks Using Deep Learning and Perceptual Hashing During Crises

The extensive use of social media platforms, especially during disasters...
research
08/29/2021

MEDIC: A Multi-Task Learning Dataset for Disaster Image Classification

Recent research in disaster informatics demonstrates a practical and imp...
research
03/03/2023

Early Warning Signals of Social Instabilities in Twitter Data

The goal of this project is to create and study novel techniques to iden...
research
06/09/2018

Localizing and Quantifying Damage in Social Media Images

Traditional post-disaster assessment of damage heavily relies on expensi...
research
02/14/2022

A Real-time System for Detecting Landslide Reports on Social Media using Artificial Intelligence

This paper presents an online system that leverages social media data in...
research
02/09/2021

Mars Image Content Classification: Three Years of NASA Deployment and Recent Advances

The NASA Planetary Data System hosts millions of images acquired from th...

Please sign up or login with your details

Forgot password? Click here to reset