Robust Non-Linear Matrix Factorization for Dictionary Learning, Denoising, and Clustering

05/04/2020
by   Jicong Fan, et al.
62

Low dimensional nonlinear structure abounds in datasets across computer vision and machine learning. Kernelized matrix factorization techniques have recently been proposed to learn these nonlinear structures from partially observed data, with impressive empirical performance, by observing that the image of the matrix in a sufficiently large feature space is low-rank. However, these nonlinear methods fail in the presence of noise or outliers. In this work, we propose a new robust nonlinear factorization method called Robust Non-Linear Matrix Factorization (RNLMF). RNLMF constructs a dictionary for the data space by factoring a kernelized feature space; a noisy matrix can then be decomposed as the sum of a sparse noise matrix and a clean data matrix that lies in a low dimensional nonlinear manifold. RNLMF is robust to noise and outliers and scales to matrices with thousands of rows and columns. Empirically, RNLMF achieves noticeable improvements over baseline methods in denoising and clustering.

READ FULL TEXT

page 7

page 8

page 9

page 10

04/11/2012

Robust Nonnegative Matrix Factorization via L_1 Norm Regularization

Nonnegative Matrix Factorization (NMF) is a widely used technique in man...
12/23/2015

k-Means Clustering Is Matrix Factorization

We show that the objective function of conventional k-means clustering c...
07/31/2017

Learning Robust Representations for Computer Vision

Unsupervised learning techniques in computer vision often require learni...
02/13/2021

Learning low-rank latent mesoscale structures in networks

It is common to use networks to encode the architecture of interactions ...
10/09/2019

Probabilistic sequential matrix factorization

We introduce the probabilistic sequential matrix factorization (PSMF) me...
05/04/2015

Self-Expressive Decompositions for Matrix Approximation and Clustering

Data-aware methods for dimensionality reduction and matrix decomposition...
05/16/2017

The Incremental Multiresolution Matrix Factorization Algorithm

Multiresolution analysis and matrix factorization are foundational tools...