l_2,p Matrix Norm and Its Application in Feature Selection

03/16/2013
by   Liping Wang, et al.
0

Recently, l_2,1 matrix norm has been widely applied to many areas such as computer vision, pattern recognition, biological study and etc. As an extension of l_1 vector norm, the mixed l_2,1 matrix norm is often used to find jointly sparse solutions. Moreover, an efficient iterative algorithm has been designed to solve l_2,1-norm involved minimizations. Actually, computational studies have showed that l_p-regularization (0<p<1) is sparser than l_1-regularization, but the extension to matrix norm has been seldom considered. This paper presents a definition of mixed l_2,p (p∈ (0, 1]) matrix pseudo norm which is thought as both generalizations of l_p vector norm to matrix and l_2,1-norm to nonconvex cases (0<p<1). Fortunately, an efficient unified algorithm is proposed to solve the induced l_2,p-norm (p∈ (0, 1]) optimization problems. The convergence can also be uniformly demonstrated for all p∈ (0, 1]. Typical p∈ (0,1] are applied to select features in computational biology and the experimental results show that some choices of 0<p<1 do improve the sparse pattern of using p=1.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/02/2015

Direct l_(2,p)-Norm Learning for Feature Selection

In this paper, we propose a novel sparse learning based feature selectio...
research
12/29/2020

Sparse PCA via l_2,p-Norm Regularization for Unsupervised Feature Selection

In the field of data mining, how to deal with high-dimensional data is a...
research
07/16/2013

Efficient Mixed-Norm Regularization: Algorithms and Safe Screening Methods

Sparse learning has recently received increasing attention in many areas...
research
10/08/2020

Robust Multi-class Feature Selection via l_2,0-Norm Regularization Minimization

Feature selection is an important data preprocessing in data mining and ...
research
10/09/2019

The fastest ℓ_1,∞ prox in the west

Proximal operators are of particular interest in optimization problems d...
research
04/06/2012

Fast projections onto mixed-norm balls with applications

Joint sparsity offers powerful structural cues for feature selection, es...
research
01/16/2013

Sparse Penalty in Deep Belief Networks: Using the Mixed Norm Constraint

Deep Belief Networks (DBN) have been successfully applied on popular mac...

Please sign up or login with your details

Forgot password? Click here to reset