RDFNet: Regional Dynamic FISTA-Net for Spectral Snapshot Compressive Imaging

02/06/2023
by   Shiyun Zhou, et al.
0

Deep convolutional neural networks have recently shown promising results in compressive spectral reconstruction. Previous methods, however, usually adopt a single mapping function for sparse representation. Considering that different regions have distinct characteristics, it is desirable to apply various mapping functions to adjust different regions' transformations dynamically. With this in mind, we first introduce a regional dynamic way of using Fast Iterative Shrinkage-Thresholding Algorithm (FISTA) to exploit regional characteristics and derive dynamic sparse representations. Then, we propose to unfold the process into a hierarchical dynamic deep network, dubbed RDFNet. The network comprises multiple regional dynamic blocks and corresponding pixel-wise adaptive soft-thresholding modules, respectively in charge of region-based dynamic mapping and pixel-wise soft-thresholding selection. The regional dynamic block guides the network to adjust the transformation domain for different regions. Equipped with the adaptive soft-thresholding, our proposed regional dynamic architecture can also learn appropriate shrinkage scale in a pixel-wise manner. Extensive experiments on both simulated and real data demonstrate that our method outperforms prior state-of-the-arts.

READ FULL TEXT

page 1

page 5

page 8

page 10

page 12

research
12/21/2021

Learned ISTA with Error-based Thresholding for Adaptive Sparse Coding

The learned iterative shrinkage thresholding algorithm (LISTA) introduce...
research
03/24/2019

Pixel-aware Deep Function-mixture Network for Spectral Super-Resolution

Spectral super-resolution (SSR) aims at generating a hyperspectral image...
research
06/22/2020

Deep Low-rank Prior in Dynamic MR Imaging

The deep learning methods have achieved attractive results in dynamic MR...
research
07/19/2023

Deep unrolling Shrinkage Network for Dynamic MR imaging

Deep unrolling networks that utilize sparsity priors have achieved great...
research
12/11/2021

CPRAL: Collaborative Panoptic-Regional Active Learning for Semantic Segmentation

Acquiring the most representative examples via active learning (AL) can ...
research
02/10/2021

Regional Attention with Architecture-Rebuilt 3D Network for RGB-D Gesture Recognition

Human gesture recognition has drawn much attention in the area of comput...
research
09/26/2017

Learning to Label Affordances from Simulated and Real Data

An autonomous robot should be able to evaluate the affordances that are ...

Please sign up or login with your details

Forgot password? Click here to reset