Intermediate and Future Frame Prediction of Geostationary Satellite Imagery With Warp and Refine Network

03/08/2023
by   Minseok Seo, et al.
0

Geostationary satellite imagery has applications in climate and weather forecasting, planning natural energy resources, and predicting extreme weather events. For precise and accurate prediction, higher spatial and temporal resolution of geostationary satellite imagery is important. Although recent geostationary satellite resolution has improved, the long-term analysis of climate applications is limited to using multiple satellites from the past to the present due to the different resolutions. To solve this problem, we proposed warp and refine network (WR-Net). WR-Net is divided into an optical flow warp component and a warp image refinement component. We used the TV-L1 algorithm instead of deep learning-based approaches to extract the optical flow warp component. The deep-learning-based model is trained on the human-centric view of the RGB channel and does not work on geostationary satellites, which is gray-scale one-channel imagery. The refinement network refines the warped image through a multi-temporal fusion layer. We evaluated WR-Net by interpolation of temporal resolution at 4 min intervals to 2 min intervals in large-scale GK2A geostationary meteorological satellite imagery. Furthermore, we applied WR-Net to the future frame prediction task and showed that the explicit use of optical flow can help future frame prediction.

READ FULL TEXT

page 2

page 3

page 4

research
07/28/2019

Optical Flow for Intermediate Frame Interpolation of Multispectral Geostationary Satellite Data

Applications of satellite data in areas such as weather tracking and mod...
research
04/16/2021

EarthNet2021: A large-scale dataset and challenge for Earth surface forecasting as a guided video prediction task

Satellite images are snapshots of the Earth surface. We propose to forec...
research
05/23/2019

Precipitation Nowcasting with Satellite Imagery

Precipitation nowcasting is a short-range forecast of rain/snow (up to 2...
research
07/22/2020

Greenhouse Segmentation on High-Resolution Optical Satellite Imagery using Deep Learning Techniques

Greenhouse segmentation has pivotal importance for climate-smart agricul...
research
10/20/2019

Predicting ice flow using machine learning

Though machine learning has achieved notable success in modeling sequent...
research
04/04/2023

Fully Convolutional Networks for Dense Water Flow Intensity Prediction in Swedish Catchment Areas

Intensifying climate change will lead to more extreme weather events, in...
research
10/02/2021

Deep Learning for Rain Fade Prediction in Satellite Communications

Line of sight satellite systems, unmanned aerial vehicles, high-altitude...

Please sign up or login with your details

Forgot password? Click here to reset