An Iteratively Re-weighted Method for Problems with Sparsity-Inducing Norms

07/02/2019
by   Feiping Nie, et al.
0

This work aims at solving the problems with intractable sparsity-inducing norms that are often encountered in various machine learning tasks, such as multi-task learning, subspace clustering, feature selection, robust principal component analysis, and so on. Specifically, an Iteratively Re-Weighted method (IRW) with solid convergence guarantee is provided. We investigate its convergence speed via numerous experiments on real data. Furthermore, in order to validate the practicality of IRW, we use it to solve a concrete robust feature selection model with complicated objective function. The experimental results show that the model coupled with proposed optimization method outperforms alternative methods significantly.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/25/2021

Feature Grouping and Sparse Principal Component Analysis

Sparse Principal Component Analysis (SPCA) is widely used in data proces...
research
10/12/2021

On the Self-Penalization Phenomenon in Feature Selection

We describe an implicit sparsity-inducing mechanism based on minimizatio...
research
12/10/2019

Unsupervised Feature Selection based on Adaptive Similarity Learning and Subspace Clustering

Feature selection methods have an important role on the readability of d...
research
10/18/2018

Distributionally Robust Reduced Rank Regression and Principal Component Analysis in High Dimensions

We propose robust sparse reduced rank regression and robust sparse princ...
research
07/18/2020

Improved Convergence Speed of Fully Symmetric Learning Rules for Principal Component Analysis

Fully symmetric learning rules for principal component analysis can be d...
research
11/25/2020

Feature Selection based on Principal Component Analysis for Underwater Source Localization by Deep Learning

In this paper, we propose an interpretable feature selection method base...
research
12/17/2012

Alternating Maximization: Unifying Framework for 8 Sparse PCA Formulations and Efficient Parallel Codes

Given a multivariate data set, sparse principal component analysis (SPCA...

Please sign up or login with your details

Forgot password? Click here to reset