PreDiff: Precipitation Nowcasting with Latent Diffusion Models

07/19/2023
by   Zhihan Gao, et al.
1

Earth system forecasting has traditionally relied on complex physical models that are computationally expensive and require significant domain expertise. In the past decade, the unprecedented increase in spatiotemporal Earth observation data has enabled data-driven forecasting models using deep learning techniques. These models have shown promise for diverse Earth system forecasting tasks but either struggle with handling uncertainty or neglect domain-specific prior knowledge, resulting in averaging possible futures to blurred forecasts or generating physically implausible predictions. To address these limitations, we propose a two-stage pipeline for probabilistic spatiotemporal forecasting: 1) We develop PreDiff, a conditional latent diffusion model capable of probabilistic forecasts. 2) We incorporate an explicit knowledge control mechanism to align forecasts with domain-specific physical constraints. This is achieved by estimating the deviation from imposed constraints at each denoising step and adjusting the transition distribution accordingly. We conduct empirical studies on two datasets: N-body MNIST, a synthetic dataset with chaotic behavior, and SEVIR, a real-world precipitation nowcasting dataset. Specifically, we impose the law of conservation of energy in N-body MNIST and anticipated precipitation intensity in SEVIR. Experiments demonstrate the effectiveness of PreDiff in handling uncertainty, incorporating domain-specific prior knowledge, and generating forecasts that exhibit high operational utility.

READ FULL TEXT

page 8

page 29

page 30

page 31

page 32

page 33

page 34

page 35

research
07/12/2022

Earthformer: Exploring Space-Time Transformers for Earth System Forecasting

Conventionally, Earth system (e.g., weather and climate) forecasting rel...
research
12/06/2022

Denoising diffusion probabilistic models for probabilistic energy forecasting

Scenario-based probabilistic forecasts have become a vital tool to equip...
research
02/03/2023

Creating Probabilistic Forecasts from Arbitrary Deterministic Forecasts using Conditional Invertible Neural Networks

In various applications, probabilistic forecasts are required to quantif...
research
02/06/2023

ProbPNN: Enhancing Deep Probabilistic Forecasting with Statistical Information

Probabilistic forecasts are essential for various downstream application...
research
07/18/2023

Knowledge-infused Deep Learning Enables Interpretable Landslide Forecasting

Forecasting how landslides will evolve over time or whether they will fa...
research
06/01/2022

Why Did This Model Forecast This Future? Closed-Form Temporal Saliency Towards Causal Explanations of Probabilistic Forecasts

Forecasting tasks surrounding the dynamics of low-level human behavior a...

Please sign up or login with your details

Forgot password? Click here to reset