Multi-Modal Machine Learning for Flood Detection in News, Social Media and Satellite Sequences

10/07/2019
by   Kashif Ahmad, et al.
0

In this paper we present our methods for the MediaEval 2019 Mul-timedia Satellite Task, which is aiming to extract complementaryinformation associated with adverse events from Social Media andsatellites. For the first challenge, we propose a framework jointly uti-lizing colour, object and scene-level information to predict whetherthe topic of an article containing an image is a flood event or not.Visual features are combined using early and late fusion techniquesachieving an average F1-score of82.63,82.40,81.40and76.77. Forthe multi-modal flood level estimation, we rely on both visualand textual information achieving an average F1-score of58.48and46.03, respectively. Finally, for the flooding detection in time-based satellite image sequences we used a combination of classicalcomputer-vision and machine learning approaches achieving anaverage F1-score of58.82

READ FULL TEXT

page 1

page 2

page 3

research
11/30/2020

Floods Detection in Twitter Text and Images

In this paper, we present our methods for the MediaEval 2020 Flood Relat...
research
12/23/2021

InstaIndoor and Multi-modal Deep Learning for Indoor Scene Recognition

Indoor scene recognition is a growing field with great potential for beh...
research
11/30/2020

Flood Detection via Twitter Streams using Textual and Visual Features

The paper presents our proposed solutions for the MediaEval 2020 Flood-R...
research
01/10/2019

Automatic detection of passable roads after floods in remote sensed and social media data

This paper addresses the problem of floods classification and floods aft...
research
04/07/2020

Bayesian aggregation improves traditional single image crop classification approaches

Machine learning (ML) methods and neural networks (NN) are widely implem...
research
10/08/2017

Clickbait detection using word embeddings

Clickbait is a pejorative term describing web content that is aimed at g...

Please sign up or login with your details

Forgot password? Click here to reset