FDNet: A Deep Learning Approach with Two Parallel Cross Encoding Pathways for Precipitation Nowcasting

05/06/2021
by   Bi-Ying Yan, et al.
11

With the goal of predicting the future rainfall intensity in a local region over a relatively short period time, precipitation nowcasting has been a long-time scientific challenge with great social and economic impact. The radar echo extrapolation approaches for precipitation nowcasting take radar echo images as input, aiming to generate future radar echo images by learning from the historical images. To effectively handle complex and high non-stationary evolution of radar echoes, we propose to decompose the movement into optical flow field motion and morphologic deformation. Following this idea, we introduce Flow-Deformation Network (FDNet), a neural network that models flow and deformation in two parallel cross pathways. The flow encoder captures the optical flow field motion between consecutive images and the deformation encoder distinguishes the change of shape from the translational motion of radar echoes. We evaluate the proposed network architecture on two real-world radar echo datasets. Our model achieves state-of-the-art prediction results compared with recent approaches. To the best of our knowledge, this is the first network architecture with flow and deformation separation to model the evolution of radar echoes for precipitation nowcasting. We believe that the general idea of this work could not only inspire much more effective approaches but also be applied to other similar spatiotemporal prediction tasks

READ FULL TEXT

page 3

page 7

page 9

page 19

page 20

page 21

page 22

research
06/25/2017

Decomposing Motion and Content for Natural Video Sequence Prediction

We propose a deep neural network for the prediction of future frames in ...
research
04/27/2023

TempEE: Temporal-Spatial Parallel Transformer for Radar Echo Extrapolation Beyond Auto-Regression

The meteorological radar reflectivity data, also known as echo, plays a ...
research
12/09/2020

Fusion of rain radar images and wind forecasts in a deep learning model applied to rain nowcasting

Short or mid-term rainfall forecasting is a major task for several envir...
research
12/12/2017

Im2Flow: Motion Hallucination from Static Images for Action Recognition

Existing methods to recognize actions in static images take the images a...
research
11/19/2018

Memory In Memory: A Predictive Neural Network for Learning Higher-Order Non-Stationarity from Spatiotemporal Dynamics

Natural spatiotemporal processes can be highly non-stationary in many wa...
research
08/17/2021

Diffeomorphic Particle Image Velocimetry

The existing particle image velocimetry (PIV) do not consider the curvat...
research
02/17/2022

Level set based particle filter driven by optical flow: an application to track the salt boundary from X-ray CT time-series

Image-based computational fluid dynamics have long played an important r...

Please sign up or login with your details

Forgot password? Click here to reset