Cross-Sensor Adversarial Domain Adaptation of Landsat-8 and Proba-V images for Cloud Detection

06/10/2020
by   Gonzalo Mateo-García, et al.
0

The number of Earth observation satellites carrying optical sensors with similar characteristics is constantly growing. Despite their similarities and the potential synergies among them, derived satellite products are often developed for each sensor independently. Differences in retrieved radiances lead to significant drops in accuracy, which hampers knowledge and information sharing across sensors. This is particularly harmful for machine learning algorithms, since gathering new ground truth data to train models for each sensor is costly and requires experienced manpower. In this work, we propose a domain adaptation transformation to reduce the statistical differences between images of two satellite sensors in order to boost the performance of transfer learning models. The proposed methodology is based on the Cycle Consistent Generative Adversarial Domain Adaptation (CyCADA) framework that trains the transformation model in an unpaired manner. In particular, Landsat-8 and Proba-V satellites, which present different but compatible spatio-spectral characteristics, are used to illustrate the method. The obtained transformation significantly reduces differences between the image datasets while preserving the spatial and spectral information of adapted images, which is hence useful for any general purpose cross-sensor application. In addition, the training of the proposed adversarial domain adaptation model can be modified to improve the performance in a specific remote sensing application, such as cloud detection, by including a dedicated term in the cost function. Results show that, when the proposed transformation is applied, cloud detection models trained in Landsat-8 data increase cloud detection accuracy in Proba-V.

READ FULL TEXT

page 1

page 5

page 9

page 10

page 11

page 12

research
12/03/2020

Deep Domain Adaptation based Cloud Type Detection using Active and Passive Satellite Data

Domain adaptation techniques have been developed to handle data from mul...
research
09/05/2023

Domain Adaptation for Satellite-Borne Hyperspectral Cloud Detection

The advent of satellite-borne machine learning hardware accelerators has...
research
04/22/2020

A Cycle GAN Approach for Heterogeneous Domain Adaptation in Land Use Classification

In the field of remote sensing and more specifically in Earth Observatio...
research
11/16/2021

SEnSeI: A Deep Learning Module for Creating Sensor Independent Cloud Masks

We introduce a novel neural network architecture – Spectral ENcoder for ...
research
12/22/2022

Semantically-consistent Landsat 8 image to Sentinel-2 image translation for alpine areas

The availability of frequent and cost-free satellite images is in growin...
research
09/13/2022

High-resolution semantically-consistent image-to-image translation

Deep learning has become one of remote sensing scientists' most efficien...
research
04/08/2020

S2A: Wasserstein GAN with Spatio-Spectral Laplacian Attention for Multi-Spectral Band Synthesis

Intersection of adversarial learning and satellite image processing is a...

Please sign up or login with your details

Forgot password? Click here to reset