A Novel Transformer Network with Shifted Window Cross-Attention for Spatiotemporal Weather Forecasting

08/02/2022
by   Alabi Bojesomo, et al.
55

Earth Observatory is a growing research area that can capitalize on the powers of AI for short time forecasting, a Now-casting scenario. In this work, we tackle the challenge of weather forecasting using a video transformer network. Vision transformer architectures have been explored in various applications, with major constraints being the computational complexity of Attention and the data hungry training. To address these issues, we propose the use of Video Swin-Transformer, coupled with a dedicated augmentation scheme. Moreover, we employ gradual spatial reduction on the encoder side and cross-attention on the decoder. The proposed approach is tested on the Weather4Cast2021 weather forecasting challenge data, which requires the prediction of 8 hours ahead future frames (4 per hour) from an hourly weather product sequence. The dataset was normalized to 0-1 to facilitate using the evaluation metrics across different datasets. The model results in an MSE score of 0.4750 when provided with training data, and 0.4420 during transfer learning without using training data, respectively.

READ FULL TEXT

page 4

page 6

page 7

page 11

page 12

research
06/28/2021

TENT: Tensorized Encoder Transformer for Temperature Forecasting

Reliable weather forecasting is of great importance in science, business...
research
04/18/2023

W-MAE: Pre-trained weather model with masked autoencoder for multi-variable weather forecasting

Weather forecasting is a long-standing computational challenge with dire...
research
07/12/2022

Earthformer: Exploring Space-Time Transformers for Earth System Forecasting

Conventionally, Earth system (e.g., weather and climate) forecasting rel...
research
07/18/2019

Video Prediction for Precipitation Nowcasting

Video prediction, which aims to synthesize new consecutive frames subseq...
research
12/05/2022

Solving the Weather4cast Challenge via Visual Transformers for 3D Images

Accurately forecasting the weather is an important task, as many real-wo...
research
01/17/2022

SwinUNet3D – A Hierarchical Architecture for Deep Traffic Prediction using Shifted Window Transformers

Traffic forecasting is an important element of mobility management, an i...
research
01/22/2023

Prompt Federated Learning for Weather Forecasting: Toward Foundation Models on Meteorological Data

To tackle the global climate challenge, it urgently needs to develop a c...

Please sign up or login with your details

Forgot password? Click here to reset