Learning Spatial-Spectral Prior for Super-Resolution of Hyperspectral Imagery

05/18/2020
by   Junjun Jiang, et al.
4

Recently, single gray/RGB image super-resolution reconstruction task has been extensively studied and made significant progress by leveraging the advanced machine learning techniques based on deep convolutional neural networks (DCNNs). However, there has been limited technical development focusing on single hyperspectral image super-resolution due to the high-dimensional and complex spectral patterns in hyperspectral image. In this paper, we make a step forward by investigating how to adapt state-of-the-art residual learning based single gray/RGB image super-resolution approaches for computationally efficient single hyperspectral image super-resolution, referred as SSPSR. Specifically, we introduce a spatial-spectral prior network (SSPN) to fully exploit the spatial information and the correlation between the spectra of the hyperspectral data. Considering that the hyperspectral training samples are scarce and the spectral dimension of hyperspectral image data is very high, it is nontrivial to train a stable and effective deep network. Therefore, a group convolution (with shared network parameters) and progressive upsampling framework is proposed. This will not only alleviate the difficulty in feature extraction due to high-dimension of the hyperspectral data, but also make the training process more stable. To exploit the spatial and spectral prior, we design a spatial-spectral block (SSB), which consists of a spatial residual module and a spectral attention residual module. Experimental results on some hyperspectral images demonstrate that the proposed SSPSR method enhances the details of the recovered high-resolution hyperspectral images, and outperforms state-of-the-arts. The source code is available at <https://github.com/junjun-jiang/SSPSR>

READ FULL TEXT

page 1

page 3

page 5

page 9

page 10

page 11

page 12

research
03/07/2021

Spatial-Spectral Feedback Network for Super-Resolution of Hyperspectral Imagery

Recently, single gray/RGB image super-resolution (SR) methods based on d...
research
06/10/2018

Accurate Spectral Super-resolution from Single RGB Image Using Multi-scale CNN

Different from traditional hyperspectral super-resolution approaches tha...
research
08/31/2021

Spectral Splitting and Aggregation Network for Hyperspectral Face Super-Resolution

High-resolution (HR) hyperspectral face image plays an important role in...
research
07/10/2020

Cross-Attention in Coupled Unmixing Nets for Unsupervised Hyperspectral Super-Resolution

The recent advancement of deep learning techniques has made great progre...
research
07/28/2020

Coupled Convolutional Neural Network with Adaptive Response Function Learning for Unsupervised Hyperspectral Super-Resolution

Due to the limitations of hyperspectral imaging systems, hyperspectral i...
research
12/29/2021

HPRN: Holistic Prior-embedded Relation Network for Spectral Super-Resolution

Spectral super-resolution (SSR) refers to the hyperspectral image (HSI) ...
research
09/03/2021

Deep Learning Approach for Hyperspectral Image Demosaicking, Spectral Correction and High-resolution RGB Reconstruction

Hyperspectral imaging is one of the most promising techniques for intrao...

Please sign up or login with your details

Forgot password? Click here to reset