A Novel Regularization Based on the Error Function for Sparse Recovery

07/06/2020
by   Weihong Guo, et al.
0

Regularization plays an important role in solving ill-posed problems by adding extra information about the desired solution, such as sparsity. Many regularization terms usually involve some vector norm, e.g., L_1 and L_2 norms. In this paper, we propose a novel regularization framework that uses the error function to approximate the unit step function. It can be considered as a surrogate function for the L_0 norm. The asymptotic behavior of the error function with respect to its intrinsic parameter indicates that the proposed regularization can approximate the standard L_0, L_1 norms as the parameter approaches to 0 and ∞, respectively. Statistically, it is also less biased than the L_1 approach. We then incorporate the error function into either a constrained or an unconstrained model when recovering a sparse signal from an under-determined linear system. Computationally, both problems can be solved via an iterative reweighted L_1 (IRL1) algorithm with guaranteed convergence. A large number of experimental results demonstrate that the proposed approach outperforms the state-of-the-art methods in various sparse recovery scenarios.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/21/2018

Is the 1-norm the best convex sparse regularization?

The 1-norm is a good convex regularization for the recovery of sparse ve...
research
03/02/2018

Optimality of 1-norm regularization among weighted 1-norms for sparse recovery: a case study on how to find optimal regularizations

The 1-norm was proven to be a good convex regularizer for the recovery o...
research
05/17/2018

Minimax regularization

Classical approach to regularization is to design norms enhancing smooth...
research
11/08/2017

Learning Sparse Visual Representations with Leaky Capped Norm Regularizers

Sparsity inducing regularization is an important part for learning over-...
research
12/20/2018

A Scale Invariant Approach for Sparse Signal Recovery

In this paper, we study the ratio of the L_1 and L_2 norms, denoted as...
research
02/20/2014

Group-sparse Matrix Recovery

We apply the OSCAR (octagonal selection and clustering algorithms for re...
research
04/19/2016

Parts for the Whole: The DCT Norm for Extreme Visual Recovery

Here we study the extreme visual recovery problem, in which over 90% of ...

Please sign up or login with your details

Forgot password? Click here to reset