NADBenchmarks – a compilation of Benchmark Datasets for Machine Learning Tasks related to Natural Disasters

12/21/2022
by   Adiba Mahbub Proma, et al.
0

Climate change has increased the intensity, frequency, and duration of extreme weather events and natural disasters across the world. While the increased data on natural disasters improves the scope of machine learning (ML) in this field, progress is relatively slow. One bottleneck is the lack of benchmark datasets that would allow ML researchers to quantify their progress against a standard metric. The objective of this short paper is to explore the state of benchmark datasets for ML tasks related to natural disasters, categorizing them according to the disaster management cycle. We compile a list of existing benchmark datasets introduced in the past five years. We propose a web platform - NADBenchmarks - where researchers can search for benchmark datasets for natural disasters, and we develop a preliminary version of such a platform using our compiled list. This paper is intended to aid researchers in finding benchmark datasets to train their ML models on, and provide general directions for topics where they can contribute new benchmark datasets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/03/2022

Analysis, Characterization, Prediction and Attribution of Extreme Atmospheric Events with Machine Learning: a Review

Atmospheric Extreme Events (EEs) cause severe damages to human societies...
research
11/19/2021

Data Excellence for AI: Why Should You Care

The efficacy of machine learning (ML) models depends on both algorithms ...
research
07/20/2022

The Game of Hidden Rules: A New Kind of Benchmark Challenge for Machine Learning

As machine learning (ML) is more tightly woven into society, it is imper...
research
12/03/2021

Reduced, Reused and Recycled: The Life of a Dataset in Machine Learning Research

Benchmark datasets play a central role in the organization of machine le...
research
07/07/2021

IowaRain: A Statewide Rain Event Dataset Based on Weather Radars and Quantitative Precipitation Estimation

Effective environmental planning and management to address climate chang...
research
01/28/2023

Bipol: Multi-axes Evaluation of Bias with Explainability in Benchmark Datasets

We evaluate five English NLP benchmark datasets (available on the superG...
research
07/14/2020

Bringing the People Back In: Contesting Benchmark Machine Learning Datasets

In response to algorithmic unfairness embedded in sociotechnical systems...

Please sign up or login with your details

Forgot password? Click here to reset