DeepAI AI Chat
Log In Sign Up

Multi-temporal Sentinel-1 and -2 Data Fusion for Optical Image Simulation

by   Wei He, et al.

In this paper, we present the optical image simulation from a synthetic aperture radar (SAR) data using deep learning based methods. Two models, i.e., optical image simulation directly from the SAR data and from multi-temporal SARoptical data, are proposed to testify the possibilities. The deep learning based methods that we chose to achieve the models are a convolutional neural network (CNN) with a residual architecture and a conditional generative adversarial network (cGAN). We validate our models using the Sentinel-1 and -2 datasets. The experiments demonstrate that the model with multi-temporal SAR-optical data can successfully simulate the optical image, meanwhile, the model with simple SAR data as input failed. The optical image simulation results indicate the possibility of SARoptical information blending for the subsequent applications such as large-scale cloud removal, and optical data temporal superresolution. We also investigate the sensitivity of the proposed models against the training samples, and reveal possible future directions.


page 4

page 5


The SEN1-2 Dataset for Deep Learning in SAR-Optical Data Fusion

While deep learning techniques have an increasing impact on many technic...

Fusing Optical and SAR time series for LAI gap filling with multioutput Gaussian processes

The availability of satellite optical information is often hampered by t...

A deep learning method for image-based subject-specific local SAR assessment

PURPOSE: Local specific absorption rate (SAR) cannot be measured and is ...

Exploring the Potential of SAR Data for Cloud Removal in Optical Satellite Imagery

The challenge of the cloud removal task can be alleviated with the aid o...

Improving Landslide Detection on SAR Data through Deep Learning

In this letter, we use deep-learning convolution neural networks (CNNs) ...

SAR-UNet: Small Attention Residual UNet for Explainable Nowcasting Tasks

The accuracy and explainability of data-driven nowcasting models are of ...