Hyperspectral Image Super-resolution with Deep Priors and Degradation Model Inversion

01/24/2022
by   Xiuheng Wang, et al.
4

To overcome inherent hardware limitations of hyperspectral imaging systems with respect to their spatial resolution, fusion-based hyperspectral image (HSI) super-resolution is attracting increasing attention. This technique aims to fuse a low-resolution (LR) HSI and a conventional high-resolution (HR) RGB image in order to obtain an HR HSI. Recently, deep learning architectures have been used to address the HSI super-resolution problem and have achieved remarkable performance. However, they ignore the degradation model even though this model has a clear physical interpretation and may contribute to improve the performance. We address this problem by proposing a method that, on the one hand, makes use of the linear degradation model in the data-fidelity term of the objective function and, on the other hand, utilizes the output of a convolutional neural network for designing a deep prior regularizer in spectral and spatial gradient domains. Experiments show the performance improvement achieved with this strategy.

READ FULL TEXT

page 1

page 4

research
06/13/2021

Enhanced Hyperspectral Image Super-Resolution via RGB Fusion and TV-TV Minimization

Hyperspectral (HS) images contain detailed spectral information that has...
research
06/10/2018

Accurate Spectral Super-resolution from Single RGB Image Using Multi-scale CNN

Different from traditional hyperspectral super-resolution approaches tha...
research
05/29/2020

Hyperspectral Image Super-resolution via Deep Spatio-spectral Convolutional Neural Networks

Hyperspectral images are of crucial importance in order to better unders...
research
03/02/2020

Gated Fusion Network for Degraded Image Super Resolution

Single image super resolution aims to enhance image quality with respect...
research
11/27/2021

Learning A 3D-CNN and Transformer Prior for Hyperspectral Image Super-Resolution

To solve the ill-posed problem of hyperspectral image super-resolution (...
research
02/21/2019

Blind Hyperspectral-Multispectral Image Fusion via Graph Laplacian Regularization

Fusing a low-resolution hyperspectral image (HSI) and a high-resolution ...
research
10/22/2021

Model Inspired Autoencoder for Unsupervised Hyperspectral Image Super-Resolution

This paper focuses on hyperspectral image (HSI) super-resolution that ai...

Please sign up or login with your details

Forgot password? Click here to reset