A Range-Null Space Decomposition Approach for Fast and Flexible Spectral Compressive Imaging

05/16/2023
by   Junyu Wang, et al.
0

We present RND-SCI, a novel framework for compressive hyperspectral image (HSI) reconstruction. Our framework decomposes the reconstructed object into range-space and null-space components, where the range-space part ensures the solution conforms to the compression process, and the null-space term introduces a deep HSI prior to constraining the output to have satisfactory properties. RND-SCI is not only simple in design with strong interpretability but also can be easily adapted to various HSI reconstruction networks, improving the quality of HSIs with minimal computational overhead. RND-SCI significantly boosts the performance of HSI reconstruction networks in retraining, fine-tuning or plugging into a pre-trained off-the-shelf model. Based on the framework and SAUNet, we design an extremely fast HSI reconstruction network, RND-SAUNet, which achieves an astounding 91 frames per second while maintaining superior reconstruction accuracy compared to other less time-consuming methods. Code and models are available at https://github.com/hustvl/RND-SCI.

READ FULL TEXT

page 1

page 7

page 12

page 13

page 14

research
08/28/2021

Self-supervised Neural Networks for Spectral Snapshot Compressive Imaging

We consider using untrained neural networks to solve the reconstruction ...
research
08/17/2021

A New Backbone for Hyperspectral Image Reconstruction

The study of 3D hyperspectral image (HSI) reconstruction refers to the i...
research
02/28/2021

OpenICS: Open Image Compressive Sensing Toolbox and Benchmark

We present OpenICS, an image compressive sensing toolbox that includes m...
research
05/17/2023

Binarized Spectral Compressive Imaging

Existing deep learning models for hyperspectral image (HSI) reconstructi...
research
01/15/2022

Spectral Compressive Imaging Reconstruction Using Convolution and Spectral Contextual Transformer

Spectral compressive imaging (SCI) is able to encode the high-dimensiona...
research
01/24/2023

A Simple Adaptive Unfolding Network for Hyperspectral Image Reconstruction

We present a simple, efficient, and scalable unfolding network, SAUNet, ...
research
03/16/2016

Deep Fully-Connected Networks for Video Compressive Sensing

In this work we present a deep learning framework for video compressive ...

Please sign up or login with your details

Forgot password? Click here to reset