An Integrated Framework for the Heterogeneous Spatio-Spectral-Temporal Fusion of Remote Sensing Images

09/01/2021
by   Menghui Jiang, et al.
8

Image fusion technology is widely used to fuse the complementary information between multi-source remote sensing images. Inspired by the frontier of deep learning, this paper first proposes a heterogeneous-integrated framework based on a novel deep residual cycle GAN. The proposed network consists of a forward fusion part and a backward degeneration feedback part. The forward part generates the desired fusion result from the various observations; the backward degeneration feedback part considers the imaging degradation process and regenerates the observations inversely from the fusion result. The proposed network can effectively fuse not only the homogeneous but also the heterogeneous information. In addition, for the first time, a heterogeneous-integrated fusion framework is proposed to simultaneously merge the complementary heterogeneous spatial, spectral and temporal information of multi-source heterogeneous observations. The proposed heterogeneous-integrated framework also provides a uniform mode that can complete various fusion tasks, including heterogeneous spatio-spectral fusion, spatio-temporal fusion, and heterogeneous spatio-spectral-temporal fusion. Experiments are conducted for two challenging scenarios of land cover changes and thick cloud coverage. Images from many remote sensing satellites, including MODIS, Landsat-8, Sentinel-1, and Sentinel-2, are utilized in the experiments. Both qualitative and quantitative evaluations confirm the effectiveness of the proposed method.

READ FULL TEXT

page 4

page 6

page 10

page 11

page 13

page 15

page 17

research
07/25/2017

Correction of "Cloud Removal By Fusing Multi-Source and Multi-Temporal Images"

Remote sensing images often suffer from cloud cover. Cloud removal is re...
research
07/06/2023

Multi-source imagery fusion using deep learning in a cloud computing platform

Given the high availability of data collected by different remote sensin...
research
04/02/2020

Graph-based fusion for change detection in multi-spectral images

In this paper we address the problem of change detection in multi-spectr...
research
06/29/2018

MRFusion: A Deep Learning architecture to fuse PAN and MS imagery for land cover mapping

Nowadays, Earth Observation systems provide a multitude of heterogeneous...
research
06/23/2021

Sentinel-1 and Sentinel-2 Spatio-Temporal Data Fusion for Clouds Removal

The abundance of clouds, located both spatially and temporally, often ma...
research
12/19/2018

Multisource and Multitemporal Data Fusion in Remote Sensing

The sharp and recent increase in the availability of data captured by di...
research
02/09/2016

A New Spatio-Spectral Morphological Segmentation For Multi-Spectral Remote-Sensing Images

A general framework of spatio-spectral segmentation for multi-spectral i...

Please sign up or login with your details

Forgot password? Click here to reset