Floods Detection in Twitter Text and Images

11/30/2020
by   Naina Said, et al.
0

In this paper, we present our methods for the MediaEval 2020 Flood Related Multimedia task, which aims to analyze and combine textual and visual content from social media for the detection of real-world flooding events. The task mainly focuses on identifying floods related tweets relevant to a specific area. We propose several schemes to address the challenge. For text-based flood events detection, we use three different methods, relying on Bog of Words (BOW) and an Italian Version of Bert individually and in combination, achieving an F1-score of 0.77 the visual analysis, we rely on features extracted via multiple state-of-the-art deep models pre-trained on ImageNet. The extracted features are then used to train multiple individual classifiers whose scores are then combined in a late fusion manner achieving an F1-score of 0.75 mandatory multi-modal run, we combine the classification scores obtained with the best textual and visual schemes in a late fusion manner. Overall, better results are obtained with the multimodal scheme achieving an F1-score of 0.80 on the development set.

READ FULL TEXT

page 1

page 2

page 3

research
11/30/2020

Flood Detection via Twitter Streams using Textual and Visual Features

The paper presents our proposed solutions for the MediaEval 2020 Flood-R...
research
10/07/2019

Multi-Modal Machine Learning for Flood Detection in News, Social Media and Satellite Sequences

In this paper we present our methods for the MediaEval 2019 Mul-timedia ...
research
05/01/2021

Capturing Logical Structure of Visually Structured Documents with Multimodal Transition Parser

While many NLP papers, tasks and pipelines assume raw, clean texts, many...
research
05/30/2022

Rites de Passage: Elucidating Displacement to Emplacement of Refugees on Twitter

Social media deliberations allow to explore refugee-related is-sues. AI-...
research
07/11/2022

A Late Fusion Framework with Multiple Optimization Methods for Media Interestingness

The recent advancement in Multimedia Analytical, Computer Vision (CV), a...
research
02/09/2022

Merit-based Fusion of NLP Techniques for Instant Feedback on Water Quality from Twitter Text

This paper focuses on an important environmental challenge; namely, wate...
research
01/10/2019

Automatic detection of passable roads after floods in remote sensed and social media data

This paper addresses the problem of floods classification and floods aft...

Please sign up or login with your details

Forgot password? Click here to reset