Deep Hyperspectral Unmixing using Transformer Network

03/31/2022
by   Preetam Ghosh, et al.
0

Currently, this paper is under review in IEEE. Transformers have intrigued the vision research community with their state-of-the-art performance in natural language processing. With their superior performance, transformers have found their way in the field of hyperspectral image classification and achieved promising results. In this article, we harness the power of transformers to conquer the task of hyperspectral unmixing and propose a novel deep unmixing model with transformers. We aim to utilize the ability of transformers to better capture the global feature dependencies in order to enhance the quality of the endmember spectra and the abundance maps. The proposed model is a combination of a convolutional autoencoder and a transformer. The hyperspectral data is encoded by the convolutional encoder. The transformer captures long-range dependencies between the representations derived from the encoder. The data are reconstructed using a convolutional decoder. We applied the proposed unmixing model to three widely used unmixing datasets, i.e., Samson, Apex, and Washington DC mall and compared it with the state-of-the-art in terms of root mean squared error and spectral angle distance. The source code for the proposed model will be made publicly available at <https://github.com/preetam22n/DeepTrans-HSU>.

READ FULL TEXT

page 1

page 3

page 6

page 8

page 9

page 10

research
09/18/2023

FactoFormer: Factorized Hyperspectral Transformers with Self-Supervised Pre-Training

Hyperspectral images (HSIs) contain rich spectral and spatial informatio...
research
03/22/2021

Transformers Solve the Limited Receptive Field for Monocular Depth Prediction

While convolutional neural networks have shown a tremendous impact on va...
research
09/04/2023

Locality-Aware Hyperspectral Classification

Hyperspectral image classification is gaining popularity for high-precis...
research
01/25/2022

DocEnTr: An End-to-End Document Image Enhancement Transformer

Document images can be affected by many degradation scenarios, which cau...
research
05/29/2023

Streaming Audio Transformers for Online Audio Tagging

Transformers have emerged as a prominent model framework for audio taggi...
research
07/06/2023

Art Authentication with Vision Transformers

In recent years, Transformers, initially developed for language, have be...
research
03/31/2023

Hierarchical Vision Transformers for Cardiac Ejection Fraction Estimation

The left ventricular of ejection fraction is one of the most important m...

Please sign up or login with your details

Forgot password? Click here to reset