Information Theoretic Limits for Standard and One-Bit Compressed Sensing with Graph-Structured Sparsity

11/16/2018
by   Adarsh Barik, et al.
0

In this paper, we analyze the information theoretic lower bound on the necessary number of samples needed for recovering a sparse signal under different compressed sensing settings. We focus on the weighted graph model, a model-based framework proposed by Hegde et al. (2015), for standard compressed sensing as well as for one-bit compressed sensing. We study both the noisy and noiseless regimes. Our analysis is general in the sense that it applies to any algorithm used to recover the signal. We carefully construct restricted ensembles for different settings and then apply Fano's inequality to establish the lower bound on the necessary number of samples. Furthermore, we show that our bound is tight for one-bit compressed sensing, while for standard compressed sensing, our bound is tight up to a logarithmic factor of the number of non-zero entries in the signal.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/26/2017

Information Theoretic Limits for Linear Prediction with Graph-Structured Sparsity

We analyze the necessary number of samples for sparse vector recovery in...
research
03/05/2022

Distributional Hardness Against Preconditioned Lasso via Erasure-Robust Designs

Sparse linear regression with ill-conditioned Gaussian random designs is...
research
12/23/2020

NBIHT: An Efficient Algorithm for 1-bit Compressed Sensing with Optimal Error Decay Rate

The Binary Iterative Hard Thresholding (BIHT) algorithm is a popular rec...
research
06/23/2023

The Proximal Operator of the Piece-wise Exponential Function and Its Application in Compressed Sensing

This paper characterizes the proximal operator of the piece-wise exponen...
research
01/27/2016

Information-theoretic limits of Bayesian network structure learning

In this paper, we study the information-theoretic limits of learning the...
research
09/01/2015

Sequential Information Guided Sensing

We study the value of information in sequential compressed sensing by ch...
research
04/06/2019

Optimal Sampling of Water Distribution Network Dynamics using Graph Fourier Transform

Water Distribution Networks (WDNs) are critical infrastructures that ens...

Please sign up or login with your details

Forgot password? Click here to reset