Polynomial-time sparse measure recovery

04/16/2022
by   Hadi Daneshmand, et al.
0

How to recover a probability measure with sparse support from particular moments? This problem has been the focus of research in theoretical computer science and neural computing. However, there is no polynomial-time algorithm for the recovery. The best algorithm for the recovery requires O(2^poly(1/ϵ)) for ϵ-accurate recovery. We propose the first poly-time recovery method from carefully designed moments that only requires O(log(1/ϵ)/ϵ^2) computations for an ϵ-accurate recovery. This method relies on the recovery of a planted two-layer neural network with two-dimensional inputs, a finite width, and zero-one activation. For such networks, we establish the first global convergence of gradient descent and demonstrate its application in sparse measure recovery.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/24/2019

Pseudo-Polynomial Time Algorithm for Computing Moments of Polynomials in Free Semicircular Elements

We consider about calculating Mth moments of a given polynomial in free ...
research
11/05/2018

Learning Two Layer Rectified Neural Networks in Polynomial Time

Consider the following fundamental learning problem: given input example...
research
07/22/2020

FPT-space Graph Kernelizations

Let n be the size of a parametrized problem and k the parameter. We pres...
research
03/26/2018

Sparse Recovery over Graph Incidence Matrices: Polynomial Time Guarantees and Location Dependent Performance

Classical results in sparse recovery guarantee the exact reconstruction ...
research
02/20/2023

Sparse PCA Beyond Covariance Thresholding

In the Wishart model for sparse PCA we are given n samples Y_1,…, Y_n dr...
research
01/09/2019

A Deterministic Algorithm for the Capacity of Finite-State Channels

We propose a modified version of the classical gradient descent method t...
research
04/28/2023

Deep Neural-network Prior for Orbit Recovery from Method of Moments

Orbit recovery problems are a class of problems that often arise in prac...

Please sign up or login with your details

Forgot password? Click here to reset