Efficient Rank Minimization via Solving Non-convexPenalties by Iterative Shrinkage-Thresholding Algorithm

09/14/2018
by   Zaiyi Chen, et al.
4

Rank minimization (RM) is a wildly investigated task of finding solutions by exploiting low-rank structure of parameter matrices. Recently, solving RM problem by leveraging non-convex relaxations has received significant attention. It has been demonstrated by some theoretical and experimental work that non-convex relaxation, e.g. Truncated Nuclear Norm Regularization (TNNR) and Reweighted Nuclear Norm Regularization (RNNR), can provide a better approximation of original problems than convex relaxations. However, designing an efficient algorithm with theoretical guarantee remains a challenging problem. In this paper, we propose a simple but efficient proximal-type method, namely Iterative Shrinkage-Thresholding Algorithm(ISTA), with concrete analysis to solve rank minimization problems with both non-convex weighted and reweighted nuclear norm as low-rank regularizers. Theoretically, the proposed method could converge to the critical point under very mild assumptions with the rate in the order of O(1/T). Moreover, the experimental results on both synthetic data and real world data sets show that proposed algorithm outperforms state-of-arts in both efficiency and accuracy.

READ FULL TEXT

page 18

page 19

page 20

research
06/11/2014

Truncated Nuclear Norm Minimization for Image Restoration Based On Iterative Support Detection

Recovering a large matrix from limited measurements is a challenging tas...
research
03/18/2013

A General Iterative Shrinkage and Thresholding Algorithm for Non-convex Regularized Optimization Problems

Non-convex sparsity-inducing penalties have recently received considerab...
research
10/27/2020

Learning Low-Rank Document Embeddings with Weighted Nuclear Norm Regularization

Recently, neural embeddings of documents have shown success in various l...
research
02/25/2016

Top-N Recommendation with Novel Rank Approximation

The importance of accurate recommender systems has been widely recognize...
research
03/28/2015

Efficient Online Minimization for Low-Rank Subspace Clustering

Low-rank representation (LRR) has been a significant method for segmenti...
research
08/14/2018

A Comprehensive Survey for Low Rank Regularization

Low rank regularization, in essence, involves introducing a low rank or ...
research
10/25/2018

Nuclear Norm Regularized Estimation of Panel Regression Models

In this paper we investigate panel regression models with interactive fi...

Please sign up or login with your details

Forgot password? Click here to reset