S2A: Wasserstein GAN with Spatio-Spectral Laplacian Attention for Multi-Spectral Band Synthesis

04/08/2020
by   Litu Rout, et al.
0

Intersection of adversarial learning and satellite image processing is an emerging field in remote sensing. In this study, we intend to address synthesis of high resolution multi-spectral satellite imagery using adversarial learning. Guided by the discovery of attention mechanism, we regulate the process of band synthesis through spatio-spectral Laplacian attention. Further, we use Wasserstein GAN with gradient penalty norm to improve training and stability of adversarial learning. In this regard, we introduce a new cost function for the discriminator based on spatial attention and domain adaptation loss. We critically analyze the qualitative and quantitative results compared with state-of-the-art methods using widely adopted evaluation metrics. Our experiments on datasets of three different sensors, namely LISS-3, LISS-4, and WorldView-2 show that attention learning performs favorably against state-of-the-art methods. Using the proposed method we provide an additional data product in consistent with existing high resolution bands. Furthermore, we synthesize over 4000 high resolution scenes covering various terrains to analyze scientific fidelity. At the end, we demonstrate plausible large scale real world applications of the synthesized band.

READ FULL TEXT

page 1

page 2

page 5

page 6

page 7

page 8

research
05/07/2019

DeepSWIR: A Deep Learning Based Approach for the Synthesis of Short-Wave InfraRed Band using Multi-Sensor Concurrent Datasets

Convolutional Neural Network (CNN) is achieving remarkable progress in v...
research
06/13/2021

Generation of the NIR spectral Band for Satellite Images with Convolutional Neural Networks

The near-infrared (NIR) spectral range (from 780 to 2500 nm) of the mult...
research
02/12/2022

RSINet: Inpainting Remotely Sensed Images Using Triple GAN Framework

We tackle the problem of image inpainting in the remote sensing domain. ...
research
12/31/2020

FGF-GAN: A Lightweight Generative Adversarial Network for Pansharpening via Fast Guided Filter

Pansharpening is a widely used image enhancement technique for remote se...
research
05/16/2021

Unsupervised Super-Resolution of Satellite Imagery for High Fidelity Material Label Transfer

Urban material recognition in remote sensing imagery is a highly relevan...
research
03/04/2021

Model-based image adjustment for a successful pansharpening

A new model-based image adjustment for the enhancement of multi-resoluti...
research
06/10/2020

Cross-Sensor Adversarial Domain Adaptation of Landsat-8 and Proba-V images for Cloud Detection

The number of Earth observation satellites carrying optical sensors with...

Please sign up or login with your details

Forgot password? Click here to reset