Comparison of convolutional neural networks for cloudy optical images reconstruction from single or multitemporal joint SAR and optical images

04/01/2022
by   Remi Cresson, et al.
5

With the increasing availability of optical and synthetic aperture radar (SAR) images thanks to the Sentinel constellation, and the explosion of deep learning, new methods have emerged in recent years to tackle the reconstruction of optical images that are impacted by clouds. In this paper, we focus on the evaluation of convolutional neural networks that use jointly SAR and optical images to retrieve the missing contents in one single polluted optical image. We propose a simple framework that ease the creation of datasets for the training of deep nets targeting optical image reconstruction, and for the validation of machine learning based or deterministic approaches. These methods are quite different in terms of input images constraints, and comparing them is a problematic task not addressed in the literature. We show how space partitioning data structures help to query samples in terms of cloud coverage, relative acquisition date, pixel validity and relative proximity between SAR and optical images. We generate several datasets to compare the reconstructed images from networks that use a single pair of SAR and optical image, versus networks that use multiple pairs, and a traditional deterministic approach performing interpolation in temporal domain.

READ FULL TEXT

page 3

page 4

page 6

page 8

page 12

page 13

page 14

page 17

research
07/26/2018

Multi-temporal Sentinel-1 and -2 Data Fusion for Optical Image Simulation

In this paper, we present the optical image simulation from a synthetic ...
research
05/03/2021

Improving Landslide Detection on SAR Data through Deep Learning

In this letter, we use deep-learning convolution neural networks (CNNs) ...
research
01/25/2018

Identifying Corresponding Patches in SAR and Optical Images with a Pseudo-Siamese CNN

In this letter, we propose a pseudo-siamese convolutional neural network...
research
03/15/2021

Boosting ship detection in SAR images with complementary pretraining techniques

Deep learning methods have made significant progress in ship detection i...
research
04/23/2020

Virtual SAR: A Synthetic Dataset for Deep Learning based Speckle Noise Reduction Algorithms

Synthetic Aperture Radar (SAR) images contain a huge amount of informati...
research
09/05/2016

Depth Reconstruction and Computer-Aided Polyp Detection in Optical Colonoscopy Video Frames

We present a computer-aided detection algorithm for polyps in optical co...
research
07/22/2022

Multi-temporal speckle reduction with self-supervised deep neural networks

Speckle filtering is generally a prerequisite to the analysis of synthet...

Please sign up or login with your details

Forgot password? Click here to reset