ISTA-Net++: Flexible Deep Unfolding Network for Compressive Sensing

03/22/2021
by   Di You, et al.
0

While deep neural networks have achieved impressive success in image compressive sensing (CS), most of them lack flexibility when dealing with multi-ratio tasks and multi-scene images in practical applications. To tackle these challenges, we propose a novel end-to-end flexible ISTA-unfolding deep network, dubbed ISTA-Net++, with superior performance and strong flexibility. Specifically, by developing a dynamic unfolding strategy, our model enjoys the adaptability of handling CS problems with different ratios, i.e., multi-ratio tasks, through a single model. A cross-block strategy is further utilized to reduce blocking artifacts and enhance the CS recovery quality. Furthermore, we adopt a balanced dataset for training, which brings more robustness when reconstructing images of multiple scenes. Extensive experiments on four datasets show that ISTA-Net++ achieves state-of-the-art results in terms of both quantitative metrics and visual quality. Considering its flexibility, effectiveness and practicability, our model is expected to serve as a suitable baseline in future CS research. The source code is available on https://github.com/jianzhangcs/ISTA-Netpp.

READ FULL TEXT

page 1

page 4

page 5

research
07/25/2022

TransCL: Transformer Makes Strong and Flexible Compressive Learning

Compressive learning (CL) is an emerging framework that integrates signa...
research
05/09/2023

Recursions Are All You Need: Towards Efficient Deep Unfolding Networks

The use of deep unfolding networks in compressive sensing (CS) has seen ...
research
04/27/2023

Optimization-Inspired Cross-Attention Transformer for Compressive Sensing

By integrating certain optimization solvers with deep neural networks, d...
research
08/28/2019

Multi-Channel Deep Networks for Block-Based Image Compressive Sensing

Incorporating deep neural networks in image compressive sensing (CS) rec...
research
12/15/2016

CSVideoNet: A Real-time End-to-end Learning Framework for High-frame-rate Video Compressive Sensing

This paper addresses the real-time encoding-decoding problem for high-fr...
research
01/20/2021

Scalable Deep Compressive Sensing

Deep learning has been used to image compressive sensing (CS) for enhanc...
research
07/15/2022

Robust Deep Compressive Sensing with Recurrent-Residual Structural Constraints

Existing deep compressive sensing (CS) methods either ignore adaptive on...

Please sign up or login with your details

Forgot password? Click here to reset