Plug-and-Play Algorithms for Large-scale Snapshot Compressive Imaging

03/30/2020
by   Xin Yuan, et al.
3

Snapshot compressive imaging (SCI) aims to capture the high-dimensional (usually 3D) images using a 2D sensor (detector) in a single snapshot. Though enjoying the advantages of low-bandwidth, low-power and low-cost, applying SCI to large-scale problems (HD or UHD videos) in our daily life is still challenging. The bottleneck lies in the reconstruction algorithms; they are either too slow (iterative optimization algorithms) or not flexible to the encoding process (deep learning based end-to-end networks). In this paper, we develop fast and flexible algorithms for SCI based on the plug-and-play (PnP) framework. In addition to the widely used PnP-ADMM method, we further propose the PnP-GAP (generalized alternating projection) algorithm with a lower computational workload and prove the global convergence of PnP-GAP under the SCI hardware constraints. By employing deep denoising priors, we first time show that PnP can recover a UHD color video (3840× 1644× 48 with PNSR above 30dB) from a snapshot 2D measurement. Extensive results on both simulation and real datasets verify the superiority of our proposed algorithm. The code is available at https://github.com/liuyang12/PnP-SCI.

READ FULL TEXT

page 2

page 7

page 8

page 13

page 14

page 15

research
08/28/2021

Self-supervised Neural Networks for Spectral Snapshot Compressive Imaging

We consider using untrained neural networks to solve the reconstruction ...
research
09/11/2021

Dual-view Snapshot Compressive Imaging via Optical Flow Aided Recurrent Neural Network

Dual-view snapshot compressive imaging (SCI) aims to capture videos from...
research
05/17/2023

EfficientSCI: Densely Connected Network with Space-time Factorization for Large-scale Video Snapshot Compressive Imaging

Video snapshot compressive imaging (SCI) uses a two-dimensional detector...
research
05/16/2020

Various Total Variation for Snapshot Video Compressive Imaging

Sampling high-dimensional images is challenging due to limited availabil...
research
09/14/2021

Dense Deep Unfolding Network with 3D-CNN Prior for Snapshot Compressive Imaging

Snapshot compressive imaging (SCI) aims to record three-dimensional sign...
research
07/11/2017

Experimental comparison of single-pixel imaging algorithms

Single-pixel imaging (SPI) is a novel technique capturing 2D images usin...
research
04/07/2021

Universal and Flexible Optical Aberration Correction Using Deep-Prior Based Deconvolution

High quality imaging usually requires bulky and expensive lenses to comp...

Please sign up or login with your details

Forgot password? Click here to reset