Robust Matrix Factorization with Grouping Effect

06/25/2021
by   Haiyan Jiang, et al.
0

Although many techniques have been applied to matrix factorization (MF), they may not fully exploit the feature structure. In this paper, we incorporate the grouping effect into MF and propose a novel method called Robust Matrix Factorization with Grouping effect (GRMF). The grouping effect is a generalization of the sparsity effect, which conducts denoising by clustering similar values around multiple centers instead of just around 0. Compared with existing algorithms, the proposed GRMF can automatically learn the grouping structure and sparsity in MF without prior knowledge, by introducing a naturally adjustable non-convex regularization to achieve simultaneous sparsity and grouping effect. Specifically, GRMF uses an efficient alternating minimization framework to perform MF, in which the original non-convex problem is first converted into a convex problem through Difference-of-Convex (DC) programming, and then solved by Alternating Direction Method of Multipliers (ADMM). In addition, GRMF can be easily extended to the Non-negative Matrix Factorization (NMF) settings. Extensive experiments have been conducted using real-world data sets with outliers and contaminated noise, where the experimental results show that GRMF has promoted performance and robustness, compared to five benchmark algorithms.

READ FULL TEXT

page 19

page 20

research
06/25/2021

Feature Grouping and Sparse Principal Component Analysis

Sparse Principal Component Analysis (SPCA) is widely used in data proces...
research
01/01/2016

Practical Algorithms for Learning Near-Isometric Linear Embeddings

We propose two practical non-convex approaches for learning near-isometr...
research
01/21/2021

A fast two-stage algorithm for non-negative matrix factorization in streaming data

In this article, we study algorithms for nonnegative matrix factorizatio...
research
09/22/2022

Non-Negative Matrix Factorization with Scale Data Structure Preservation

The model described in this paper belongs to the family of non-negative ...
research
10/19/2017

Efficient Robust Matrix Factorization with Nonconvex Loss

Robust matrix factorization (RMF), which uses the ℓ_1-loss, often outper...
research
10/19/2017

Scalable Robust Matrix Factorization with Nonconvex Loss

Robust matrix factorization (RMF), which uses the ℓ_1-loss, often outper...
research
02/12/2016

Pursuits in Structured Non-Convex Matrix Factorizations

Efficiently representing real world data in a succinct and parsimonious ...

Please sign up or login with your details

Forgot password? Click here to reset