Support Localization and the Fisher Metric for off-the-grid Sparse Regularization

10/08/2018
by   Clarice Poon, et al.
0

Sparse regularization is a central technique for both machine learning (to achieve supervised features selection or unsupervised mixture learning) and imaging sciences (to achieve super-resolution). Existing performance guaranties assume a separation of the spikes based on an ad-hoc (usually Euclidean) minimum distance condition, which ignores the geometry of the problem. In this article, we study the BLASSO (i.e. the off-the-grid version of ℓ^1 LASSO regularization) and show that the Fisher-Rao distance is the natural way to ensure and quantify support recovery, since it preserves the invariance of the problem under reparameterization. We prove that under mild regularity and curvature conditions, stable support identification is achieved even in the presence of randomized sub-sampled observations (which is the case in compressed sensing or learning scenario). On deconvolution problems, which are translation invariant, this generalizes to the multi-dimensional setting existing results of the literature. For more complex translation-varying problems, such as Laplace transform inversion, this gives the first geometry-aware guarantees for sparse recovery.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/23/2018

A Dual Certificates Analysis of Compressive Off-the-Grid Recovery

Many problems in machine learning and imaging can be framed as an infini...
research
02/17/2019

Bayesian Regularization: From Tikhonov to Horseshoe

Bayesian regularization is a central tool in modern-day statistical and ...
research
10/29/2019

Support Recovery for Sparse Signals with Non-stationary Modulation

The problem of estimating a sparse signal from low dimensional noisy obs...
research
07/23/2019

Sparse Regularization for Mixture Problems

This paper investigates the statistical estimation of a discrete mixing ...
research
11/11/2013

Toward a unified theory of sparse dimensionality reduction in Euclidean space

Let Φ∈R^m× n be a sparse Johnson-Lindenstrauss transform [KN14] with s n...
research
02/12/2023

On the accuracy of Prony's method for recovery of exponential sums with closely spaced exponents

In this paper we establish accuracy bounds of Prony's method (PM) for re...
research
07/10/2020

Adaptive Superresolution in Deconvolution of Sparse Peaks

The aim of this paper is to investigate superresolution in deconvolution...

Please sign up or login with your details

Forgot password? Click here to reset