Degradation-Aware Unfolding Half-Shuffle Transformer for Spectral Compressive Imaging

05/20/2022
by   Yuanhao Cai, et al.
0

In coded aperture snapshot spectral compressive imaging (CASSI) systems, hyperspectral image (HSI) reconstruction methods are employed to recover the spatial-spectral signal from a compressed measurement. Among these algorithms, deep unfolding methods demonstrate promising performance but suffer from two issues. Firstly, they do not estimate the degradation patterns and ill-posedness degree from the highly related CASSI to guide the iterative learning. Secondly, they are mainly CNN-based, showing limitations in capturing long-range dependencies. In this paper, we propose a principled Degradation-Aware Unfolding Framework (DAUF) that estimates parameters from the compressed image and physical mask, and then uses these parameters to control each iteration. Moreover, we customize a novel Half-Shuffle Transformer (HST) that simultaneously captures local contents and non-local dependencies. By plugging HST into DAUF, we establish the first Transformer-based deep unfolding method, Degradation-Aware Unfolding Half-Shuffle Transformer (DAUHST), for HSI reconstruction. Experiments show that DAUHST significantly surpasses state-of-the-art methods while requiring cheaper computational and memory costs. Code and models will be released to the public.

READ FULL TEXT

page 7

page 8

page 9

research
05/06/2023

Degradation-Noise-Aware Deep Unfolding Transformer for Hyperspectral Image Denoising

Hyperspectral imaging (HI) has emerged as a powerful tool in diverse fie...
research
11/13/2022

Residual Degradation Learning Unfolding Framework with Mixing Priors across Spectral and Spatial for Compressive Spectral Imaging

To acquire a snapshot spectral image, coded aperture snapshot spectral i...
research
04/05/2023

MethaneMapper: Spectral Absorption aware Hyperspectral Transformer for Methane Detection

Methane (CH_4) is the chief contributor to global climate change. Recent...
research
01/15/2022

Spectral Compressive Imaging Reconstruction Using Convolution and Spectral Contextual Transformer

Spectral compressive imaging (SCI) is able to encode the high-dimensiona...
research
09/24/2022

S^2-Transformer for Mask-Aware Hyperspectral Image Reconstruction

The technology of hyperspectral imaging (HSI) records the visual informa...
research
05/06/2023

SST-ReversibleNet: Reversible-prior-based Spectral-Spatial Transformer for Efficient Hyperspectral Image Reconstruction

Spectral image reconstruction is an important task in snapshot compresse...
research
08/21/2023

Pixel Adaptive Deep Unfolding Transformer for Hyperspectral Image Reconstruction

Hyperspectral Image (HSI) reconstruction has made gratifying progress wi...

Please sign up or login with your details

Forgot password? Click here to reset