Unsupervised Sparse Dirichlet-Net for Hyperspectral Image Super-Resolution

04/13/2018
by   Ying Qu, et al.
0

In many computer vision applications, obtaining images of high resolution in both the spatial and spectral domains are equally important. However, due to hardware limitations, one can only expect to acquire images of high resolution in either the spatial or spectral domains. This paper focuses on hyperspectral image super-resolution (HSI-SR), where a hyperspectral image (HSI) with low spatial resolution (LR) but high spectral resolution is fused with a multispectral image (MSI) with high spatial resolution (HR) but low spectral resolution to obtain HR HSI. Existing deep learning-based solutions are all supervised that would need a large training set and the availability of HR HSI, which is unrealistic. Here, we make the first attempt to solving the HSI-SR problem using an unsupervised encoder-decoder architecture that carries the following uniquenesses. First, it is composed of two encoder-decoder networks, coupled through a shared decoder, in order to preserve the rich spectral information from the HSI network. Second, the network encourages the representations from both modalities to follow a sparse Dirichlet distribution which naturally incorporates the two physical constraints of HSI and MSI. Third, the angular difference between representations are minimized in order to reduce the spectral distortion. We refer to the proposed architecture as unsupervised Sparse Dirichlet-Net, or uSDN. Extensive experimental results demonstrate the superior performance of uSDN as compared to the state-of-the-art.

READ FULL TEXT

page 7

page 8

research
04/27/2019

Unsupervised and Unregistered Hyperspectral Image Super-Resolution with Mutual Dirichlet-Net

Hyperspectral images (HSI) provide rich spectral information that contri...
research
10/22/2021

Model Inspired Autoencoder for Unsupervised Hyperspectral Image Super-Resolution

This paper focuses on hyperspectral image (HSI) super-resolution that ai...
research
11/16/2021

A Latent Encoder Coupled Generative Adversarial Network (LE-GAN) for Efficient Hyperspectral Image Super-resolution

Realistic hyperspectral image (HSI) super-resolution (SR) techniques aim...
research
06/13/2021

Enhanced Hyperspectral Image Super-Resolution via RGB Fusion and TV-TV Minimization

Hyperspectral (HS) images contain detailed spectral information that has...
research
03/19/2021

Hyperspectral Image Super-Resolution in Arbitrary Input-Output Band Settings

Hyperspectral images (HSIs) with narrow spectral bands can capture rich ...
research
04/10/2023

Hyperspectral Image Super-Resolution via Dual-domain Network Based on Hybrid Convolution

Since the number of incident energies is limited, it is difficult to dir...
research
08/31/2021

Spectral Splitting and Aggregation Network for Hyperspectral Face Super-Resolution

High-resolution (HR) hyperspectral face image plays an important role in...

Please sign up or login with your details

Forgot password? Click here to reset