Multi-temporal Sentinel-1 and -2 Data Fusion for Optical Image Simulation

07/26/2018
by   Wei He, et al.
0

In this paper, we present the optical image simulation from a synthetic aperture radar (SAR) data using deep learning based methods. Two models, i.e., optical image simulation directly from the SAR data and from multi-temporal SARoptical data, are proposed to testify the possibilities. The deep learning based methods that we chose to achieve the models are a convolutional neural network (CNN) with a residual architecture and a conditional generative adversarial network (cGAN). We validate our models using the Sentinel-1 and -2 datasets. The experiments demonstrate that the model with multi-temporal SAR-optical data can successfully simulate the optical image, meanwhile, the model with simple SAR data as input failed. The optical image simulation results indicate the possibility of SARoptical information blending for the subsequent applications such as large-scale cloud removal, and optical data temporal superresolution. We also investigate the sensitivity of the proposed models against the training samples, and reveal possible future directions.

READ FULL TEXT

page 4

page 5

research
07/04/2018

The SEN1-2 Dataset for Deep Learning in SAR-Optical Data Fusion

While deep learning techniques have an increasing impact on many technic...
research
02/03/2020

A deep learning method for image-based subject-specific local SAR assessment

PURPOSE: Local specific absorption rate (SAR) cannot be measured and is ...
research
06/06/2022

Exploring the Potential of SAR Data for Cloud Removal in Optical Satellite Imagery

The challenge of the cloud removal task can be alleviated with the aid o...
research
05/03/2021

Improving Landslide Detection on SAR Data through Deep Learning

In this letter, we use deep-learning convolution neural networks (CNNs) ...
research
12/05/2020

Fusing Optical and SAR time series for LAI gap filling with multioutput Gaussian processes

The availability of satellite optical information is often hampered by t...
research
08/05/2019

Blind SAR Image Despeckling Using Self-Supervised Dense Dilated Convolutional Neural Network

Despeckling is a key and indispensable step in SAR image preprocessing, ...

Please sign up or login with your details

Forgot password? Click here to reset