SEnSeI: A Deep Learning Module for Creating Sensor Independent Cloud Masks

11/16/2021
by   Alistair Francis, et al.
11

We introduce a novel neural network architecture – Spectral ENcoder for SEnsor Independence (SEnSeI) – by which several multispectral instruments, each with different combinations of spectral bands, can be used to train a generalised deep learning model. We focus on the problem of cloud masking, using several pre-existing datasets, and a new, freely available dataset for Sentinel-2. Our model is shown to achieve state-of-the-art performance on the satellites it was trained on (Sentinel-2 and Landsat 8), and is able to extrapolate to sensors it has not seen during training such as Landsat 7, PerúSat-1, and Sentinel-3 SLSTR. Model performance is shown to improve when multiple satellites are used in training, approaching or surpassing the performance of specialised, single-sensor models. This work is motivated by the fact that the remote sensing community has access to data taken with a hugely variety of sensors. This has inevitably led to labelling efforts being undertaken separately for different sensors, which limits the performance of deep learning models, given their need for huge training sets to perform optimally. Sensor independence can enable deep learning models to utilise multiple datasets for training simultaneously, boosting performance and making them much more widely applicable. This may lead to deep learning approaches being used more frequently for on-board applications and in ground segment data processing, which generally require models to be ready at launch or soon afterwards.

READ FULL TEXT

page 1

page 6

page 12

page 14

page 16

page 22

research
08/11/2021

Representation Learning for Remote Sensing: An Unsupervised Sensor Fusion Approach

In the application of machine learning to remote sensing, labeled data i...
research
06/10/2020

Cross-Sensor Adversarial Domain Adaptation of Landsat-8 and Proba-V images for Cloud Detection

The number of Earth observation satellites carrying optical sensors with...
research
12/14/2019

Sensor-Independent Illumination Estimation for DNN Models

While modern deep neural networks (DNNs) achieve state-of-the-art result...
research
10/28/2022

Using Supervised Deep-Learning to Model Edge-FBG Shape Sensors

Continuum robots in robot-assisted minimally invasive surgeries provide ...
research
12/06/2019

Modeling the Chlorophyll-a from Sea Surface Reflectance in West Africa by Deep Learning Methods: A Comparison of Multiple Algorithms

Deep learning provide successful applications in many fields. Recently, ...
research
06/17/2022

Design of Multi-model Linear Inferential Sensors with SVM-based Switching Logic

We study the problem of data-based design of multi-model linear inferent...
research
02/28/2022

Gait Events Prediction using Hybrid CNN-RNN-based Deep Learning models through a Single Waist-worn Wearable Sensor

Elderly gait is a source of rich information about their physical and me...

Please sign up or login with your details

Forgot password? Click here to reset