Robust Non-Linear Matrix Factorization for Dictionary Learning, Denoising, and Clustering

by   Jicong Fan, et al.

Low dimensional nonlinear structure abounds in datasets across computer vision and machine learning. Kernelized matrix factorization techniques have recently been proposed to learn these nonlinear structures from partially observed data, with impressive empirical performance, by observing that the image of the matrix in a sufficiently large feature space is low-rank. However, these nonlinear methods fail in the presence of noise or outliers. In this work, we propose a new robust nonlinear factorization method called Robust Non-Linear Matrix Factorization (RNLMF). RNLMF constructs a dictionary for the data space by factoring a kernelized feature space; a noisy matrix can then be decomposed as the sum of a sparse noise matrix and a clean data matrix that lies in a low dimensional nonlinear manifold. RNLMF is robust to noise and outliers and scales to matrices with thousands of rows and columns. Empirically, RNLMF achieves noticeable improvements over baseline methods in denoising and clustering.


page 7

page 8

page 9

page 10


Robust Nonnegative Matrix Factorization via L_1 Norm Regularization

Nonnegative Matrix Factorization (NMF) is a widely used technique in man...

k-Means Clustering Is Matrix Factorization

We show that the objective function of conventional k-means clustering c...

Learning Robust Representations for Computer Vision

Unsupervised learning techniques in computer vision often require learni...

Learning low-rank latent mesoscale structures in networks

It is common to use networks to encode the architecture of interactions ...

Probabilistic sequential matrix factorization

We introduce the probabilistic sequential matrix factorization (PSMF) me...

Self-Expressive Decompositions for Matrix Approximation and Clustering

Data-aware methods for dimensionality reduction and matrix decomposition...

The Incremental Multiresolution Matrix Factorization Algorithm

Multiresolution analysis and matrix factorization are foundational tools...