Deep Fully-Connected Networks for Video Compressive Sensing

03/16/2016
by   Michael Iliadis, et al.
1

In this work we present a deep learning framework for video compressive sensing. The proposed formulation enables recovery of video frames in a few seconds at significantly improved reconstruction quality compared to previous approaches. Our investigation starts by learning a linear mapping between video sequences and corresponding measured frames which turns out to provide promising results. We then extend the linear formulation to deep fully-connected networks and explore the performance gains using deeper architectures. Our analysis is always driven by the applicability of the proposed framework on existing compressive video architectures. Extensive simulations on several video sequences document the superiority of our approach both quantitatively and qualitatively. Finally, our analysis offers insights into understanding how dataset sizes and number of layers affect reconstruction performance while raising a few points for future investigation. Code is available at Github: https://github.com/miliadis/DeepVideoCS

READ FULL TEXT

page 6

page 7

page 9

page 11

research
07/12/2016

DeepBinaryMask: Learning a Binary Mask for Video Compressive Sensing

In this paper, we propose a novel encoder-decoder neural network model r...
research
02/28/2021

OpenICS: Open Image Compressive Sensing Toolbox and Benchmark

We present OpenICS, an image compressive sensing toolbox that includes m...
research
10/12/2014

Tree-Structure Bayesian Compressive Sensing for Video

A Bayesian compressive sensing framework is developed for video reconstr...
research
04/01/2021

Distributed Video Adaptive Block Compressive Sensing

Video block compressive sensing has been studied for use in resource con...
research
04/12/2022

FSOINet: Feature-Space Optimization-Inspired Network for Image Compressive Sensing

In recent years, deep learning-based image compressive sensing (ICS) met...
research
05/09/2023

Recursions Are All You Need: Towards Efficient Deep Unfolding Networks

The use of deep unfolding networks in compressive sensing (CS) has seen ...
research
05/16/2023

A Range-Null Space Decomposition Approach for Fast and Flexible Spectral Compressive Imaging

We present RND-SCI, a novel framework for compressive hyperspectral imag...

Please sign up or login with your details

Forgot password? Click here to reset