MRFusion: A Deep Learning architecture to fuse PAN and MS imagery for land cover mapping

06/29/2018
by   Raffaele Gaetano, et al.
4

Nowadays, Earth Observation systems provide a multitude of heterogeneous remote sensing data. How to manage such richness leveraging its complementarity is a crucial chal- lenge in modern remote sensing analysis. Data Fusion techniques deal with this point proposing method to combine and exploit complementarity among the different data sensors. Considering optical Very High Spatial Resolution (VHSR) images, satellites obtain both Multi Spectral (MS) and panchro- matic (PAN) images at different spatial resolution. VHSR images are extensively exploited to produce land cover maps to deal with agricultural, ecological, and socioeconomic issues as well as assessing ecosystem status, monitoring biodiversity and provid- ing inputs to conceive food risk monitoring systems. Common techniques to produce land cover maps from such VHSR images typically opt for a prior pansharpening of the multi-resolution source for a full resolution processing. Here, we propose a new deep learning architecture to jointly use PAN and MS imagery for a direct classification without any prior image fusion or resampling process. By managing the spectral information at its native spatial resolution, our method, named MRFusion, aims at avoiding the possible infor- mation loss induced by pansharpening or any other hand-crafted preprocessing. Moreover, the proposed architecture is suitably designed to learn non-linear transformations of the sources with the explicit aim of taking as much as possible advantage of the complementarity of PAN and MS imagery. Experiments are carried out on two-real world scenarios depicting large areas with different land cover characteristics. The characteristics of the proposed scenarios underline the applicability and the generality of our method in operational settings.

READ FULL TEXT

page 4

page 7

page 8

page 9

research
03/05/2018

M3Fusion: A Deep Learning Architecture for Multi-Scale/Modal/Temporal satellite data fusion

Modern Earth Observation systems provide sensing data at different tempo...
research
05/01/2019

Land Use and Land Cover Classification Using Deep Learning Techniques

Large datasets of sub-meter aerial imagery represented as orthophoto mos...
research
08/02/2017

Land Cover Classification from Multi-temporal, Multi-spectral Remotely Sensed Imagery using Patch-Based Recurrent Neural Networks

Sustainability of the global environment is dependent on the accurate la...
research
01/16/2017

Automatic Spatial Context-Sensitive Cloud/Cloud-Shadow Detection in Multi-Source Multi-Spectral Earth Observation Images: AutoCloud+

The proposed Earth observation (EO) based value adding system (EO VAS), ...
research
09/01/2021

An Integrated Framework for the Heterogeneous Spatio-Spectral-Temporal Fusion of Remote Sensing Images

Image fusion technology is widely used to fuse the complementary informa...
research
11/23/2020

Building a Parallel Universe Image Synthesis from Land Cover Maps and Auxiliary Raster Data

We synthesize both optical RGB and SAR remote sensing images from land c...
research
03/01/2022

Exploring Wilderness Using Explainable Machine Learning in Satellite Imagery

Wilderness areas offer important ecological and social benefits, and the...

Please sign up or login with your details

Forgot password? Click here to reset