Spatial-Spectral Feedback Network for Super-Resolution of Hyperspectral Imagery

03/07/2021
by   Enhai Liu, et al.
0

Recently, single gray/RGB image super-resolution (SR) methods based on deep learning have achieved great success. However, there are two obstacles to limit technical development in the single hyperspectral image super-resolution. One is the high-dimensional and complex spectral patterns in hyperspectral image, which make it difficult to explore spatial information and spectral information among bands simultaneously. The other is that the number of available hyperspectral training samples is extremely small, which can easily lead to overfitting when training a deep neural network. To address these issues, in this paper, we propose a novel Spatial-Spectral Feedback Network (SSFN) to refine low-level representations among local spectral bands with high-level information from global spectral bands. It will not only alleviate the difficulty in feature extraction due to high dimensional of hyperspectral data, but also make the training process more stable. Specifically, we use hidden states in an RNN with finite unfoldings to achieve such feedback manner. To exploit the spatial and spectral prior, a Spatial-Spectral Feedback Block (SSFB) is designed to handle the feedback connections and generate powerful high-level representations. The proposed SSFN comes with a early predictions and can reconstruct the final high-resolution hyperspectral image step by step. Extensive experimental results on three benchmark datasets demonstrate that the proposed SSFN achieves superior performance in comparison with the state-of-the-art methods. The source code is available at https://github.com/tangzhenjie/SSFN.

READ FULL TEXT

page 1

page 2

page 8

research
05/18/2020

Learning Spatial-Spectral Prior for Super-Resolution of Hyperspectral Imagery

Recently, single gray/RGB image super-resolution reconstruction task has...
research
03/23/2019

Feedback Network for Image Super-Resolution

Recent advances in image super-resolution (SR) explored the power of dee...
research
01/14/2020

Spatial-Spectral Residual Network for Hyperspectral Image Super-Resolution

Deep learning-based hyperspectral image super-resolution (SR) methods ha...
research
05/30/2022

Deep Posterior Distribution-based Embedding for Hyperspectral Image Super-resolution

In this paper, we investigate the problem of hyperspectral (HS) image sp...
research
01/19/2021

Hyperspectral Image Super-Resolution with Spectral Mixup and Heterogeneous Datasets

This work studies Hyperspectral image (HSI) super-resolution (SR). HSI S...
research
08/31/2021

Spectral Splitting and Aggregation Network for Hyperspectral Face Super-Resolution

High-resolution (HR) hyperspectral face image plays an important role in...
research
03/19/2021

Hyperspectral Image Super-Resolution in Arbitrary Input-Output Band Settings

Hyperspectral images (HSIs) with narrow spectral bands can capture rich ...

Please sign up or login with your details

Forgot password? Click here to reset