EarthNet2021: A novel large-scale dataset and challenge for forecasting localized climate impacts

by   Christian Requena-Mesa, et al.

Climate change is global, yet its concrete impacts can strongly vary between different locations in the same region. Seasonal weather forecasts currently operate at the mesoscale (> 1 km). For more targeted mitigation and adaptation, modelling impacts to < 100 m is needed. Yet, the relationship between driving variables and Earth's surface at such local scales remains unresolved by current physical models. Large Earth observation datasets now enable us to create machine learning models capable of translating coarse weather information into high-resolution Earth surface forecasts. Here, we define high-resolution Earth surface forecasting as video prediction of satellite imagery conditional on mesoscale weather forecasts. Video prediction has been tackled with deep learning models. Developing such models requires analysis-ready datasets. We introduce EarthNet2021, a new, curated dataset containing target spatio-temporal Sentinel 2 satellite imagery at 20 m resolution, matched with high-resolution topography and mesoscale (1.28 km) weather variables. With over 32000 samples it is suitable for training deep neural networks. Comparing multiple Earth surface forecasts is not trivial. Hence, we define the EarthNetScore, a novel ranking criterion for models forecasting Earth surface reflectance. For model intercomparison we frame EarthNet2021 as a challenge with four tracks based on different test sets. These allow evaluation of model validity and robustness as well as model applicability to extreme events and the complete annual vegetation cycle. In addition to forecasting directly observable weather impacts through satellite-derived vegetation indices, capable Earth surface models will enable downstream applications such as crop yield prediction, forest health assessments, coastline management, or biodiversity monitoring. Find data, code, and how to participate at .


page 1

page 2

page 3


EarthNet2021: A large-scale dataset and challenge for Earth surface forecasting as a guided video prediction task

Satellite images are snapshots of the Earth surface. We propose to forec...

CloudCast: A Satellite-Based Dataset and Baseline for Forecasting Clouds

Forecasting the formation and development of clouds is a central element...

High Resolution Forecasting of Heat Waves impacts on Leaf Area Index by Multiscale Multitemporal Deep Learning

Climate change impacts could cause progressive decrease of crop quality ...

TeleViT: Teleconnection-driven Transformers Improve Subseasonal to Seasonal Wildfire Forecasting

Wildfires are increasingly exacerbated as a result of climate change, ne...

Toward Foundation Models for Earth Monitoring: Generalizable Deep Learning Models for Natural Hazard Segmentation

Climate change results in an increased probability of extreme weather ev...

Schedule Earth Observation satellites with Deep Reinforcement Learning

Optical Earth observation satellites acquire images worldwide , covering...

Learning to forecast vegetation greenness at fine resolution over Africa with ConvLSTMs

Forecasting the state of vegetation in response to climate and weather e...

Please sign up or login with your details

Forgot password? Click here to reset