Non-Convex Compressed Sensing with Training Data

01/20/2021
by   G. Welper, et al.
0

Efficient algorithms for the sparse solution of under-determined linear systems Ax = b are known for matrices A satisfying suitable assumptions like the restricted isometry property (RIP). Without such assumptions little is known and without any assumptions on A the problem is NP-hard. A common approach is to replace ℓ_1 by ℓ_p minimization for 0 < p < 1, which is no longer convex and typically requires some form of local initial values for provably convergent algorithms. In this paper, we consider an alternative, where instead of suitable initial values we are provided with extra training problems Ax = B_l, l=1, …, p that are related to our compressed sensing problem. They allow us to find the solution of the original problem Ax = b with high probability in the range of a one layer linear neural network with comparatively few assumptions on the matrix A.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/16/2013

Optimization for Compressed Sensing: the Simplex Method and Kronecker Sparsification

In this paper we present two new approaches to efficiently solve large-s...
research
02/06/2023

Learning Trees of ℓ_0-Minimization Problems

The problem of computing minimally sparse solutions of under-determined ...
research
02/23/2017

Horseshoe Regularization for Feature Subset Selection

Feature subset selection arises in many high-dimensional applications of...
research
07/17/2013

Universally Elevating the Phase Transition Performance of Compressed Sensing: Non-Isometric Matrices are Not Necessarily Bad Matrices

In compressed sensing problems, ℓ_1 minimization or Basis Pursuit was kn...
research
05/22/2020

The Average-Case Time Complexity of Certifying the Restricted Isometry Property

In compressed sensing, the restricted isometry property (RIP) on M × N s...
research
02/03/2020

A Relaxation Argument for Optimization in Neural Networks and Non-Convex Compressed Sensing

It has been observed in practical applications and in theoretical analys...
research
10/20/2016

Efficient Estimation of Compressible State-Space Models with Application to Calcium Signal Deconvolution

In this paper, we consider linear state-space models with compressible i...

Please sign up or login with your details

Forgot password? Click here to reset