Multi-temporal and multi-source remote sensing image classification by nonlinear relative normalization

12/07/2020
by   Devis Tuia, et al.
0

Remote sensing image classification exploiting multiple sensors is a very challenging problem: data from different modalities are affected by spectral distortions and mis-alignments of all kinds, and this hampers re-using models built for one image to be used successfully in other scenes. In order to adapt and transfer models across image acquisitions, one must be able to cope with datasets that are not co-registered, acquired under different illumination and atmospheric conditions, by different sensors, and with scarce ground references. Traditionally, methods based on histogram matching have been used. However, they fail when densities have very different shapes or when there is no corresponding band to be matched between the images. An alternative builds upon manifold alignment. Manifold alignment performs a multidimensional relative normalization of the data prior to product generation that can cope with data of different dimensionality (e.g. different number of bands) and possibly unpaired examples. Aligning data distributions is an appealing strategy, since it allows to provide data spaces that are more similar to each other, regardless of the subsequent use of the transformed data. In this paper, we study a methodology that aligns data from different domains in a nonlinear way through kernelization. We introduce the Kernel Manifold Alignment (KEMA) method, which provides a flexible and discriminative projection map, exploits only a few labeled samples (or semantic ties) in each domain, and reduces to solving a generalized eigenvalue problem. We successfully test KEMA in multi-temporal and multi-source very high resolution classification tasks, as well as on the task of making a model invariant to shadowing for hyperspectral imaging.

READ FULL TEXT

page 5

page 11

page 12

page 17

page 19

page 20

page 22

page 23

research
04/15/2021

Semisupervised Manifold Alignment of Multimodal Remote Sensing Images

We introduce a method for manifold alignment of different modalities (or...
research
10/18/2013

Advances in Hyperspectral Image Classification: Earth monitoring with statistical learning methods

Hyperspectral images show similar statistical properties to natural gray...
research
03/29/2023

Nearest Neighbor Based Out-of-Distribution Detection in Remote Sensing Scene Classification

Deep learning models for image classification are typically trained unde...
research
04/09/2015

Kernel Manifold Alignment

We introduce a kernel method for manifold alignment (KEMA) and domain ad...
research
06/14/2021

Automatically eliminating seam lines with Poisson editing in complex relative radiometric normalization mosaicking scenarios

Relative radiometric normalization (RRN) mosaicking among multiple remot...
research
12/07/2020

Randomized kernels for large scale Earth observation applications

Dealing with land cover classification of the new image sources has also...

Please sign up or login with your details

Forgot password? Click here to reset