GlobalMind: Global Multi-head Interactive Self-attention Network for Hyperspectral Change Detection

04/18/2023
by   Meiqi Hu, et al.
3

High spectral resolution imagery of the Earth's surface enables users to monitor changes over time in fine-grained scale, playing an increasingly important role in agriculture, defense, and emergency response. However, most current algorithms are still confined to describing local features and fail to incorporate a global perspective, which limits their ability to capture interactions between global features, thus usually resulting in incomplete change regions. In this paper, we propose a Global Multi-head INteractive self-attention change Detection network (GlobalMind) to explore the implicit correlation between different surface objects and variant land cover transformations, acquiring a comprehensive understanding of the data and accurate change detection result. Firstly, a simple but effective Global Axial Segmentation (GAS) strategy is designed to expand the self-attention computation along the row space or column space of hyperspectral images, allowing the global connection with high efficiency. Secondly, with GAS, the global spatial multi-head interactive self-attention (Global-M) module is crafted to mine the abundant spatial-spectral feature involving potential correlations between the ground objects from the entire rich and complex hyperspectral space. Moreover, to acquire the accurate and complete cross-temporal changes, we devise a global temporal interactive multi-head self-attention (GlobalD) module which incorporates the relevance and variation of bi-temporal spatial-spectral features, deriving the integrate potential same kind of changes in the local and global range with the combination of GAS. We perform extensive experiments on five mostly used hyperspectral datasets, and our method outperforms the state-of-the-art algorithms with high accuracy and efficiency.

READ FULL TEXT

page 2

page 3

page 6

page 7

page 8

page 9

page 10

page 11

research
03/24/2023

EMS-Net: Efficient Multi-Temporal Self-Attention For Hyperspectral Change Detection

Hyperspectral change detection plays an essential role of monitoring the...
research
11/25/2022

Spatial-Spectral Transformer for Hyperspectral Image Denoising

Hyperspectral image (HSI) denoising is a crucial preprocessing procedure...
research
05/04/2022

Dual Cross-Attention Learning for Fine-Grained Visual Categorization and Object Re-Identification

Recently, self-attention mechanisms have shown impressive performance in...
research
12/15/2020

GTA: Global Temporal Attention for Video Action Understanding

Self-attention learns pairwise interactions via dot products to model lo...
research
06/25/2021

HAN: An Efficient Hierarchical Self-Attention Network for Skeleton-Based Gesture Recognition

Previous methods for skeleton-based gesture recognition mostly arrange t...
research
01/27/2023

Mixed Attention Network for Hyperspectral Image Denoising

Hyperspectral image denoising is unique for the highly similar and corre...

Please sign up or login with your details

Forgot password? Click here to reset