Simple and practical algorithms for ℓ_p-norm low-rank approximation

05/24/2018
by   Anastasios Kyrillidis, et al.
0

We propose practical algorithms for entrywise ℓ_p-norm low-rank approximation, for p = 1 or p = ∞. The proposed framework, which is non-convex and gradient-based, is easy to implement and typically attains better approximations, faster, than state of the art. From a theoretical standpoint, we show that the proposed scheme can attain (1 + ε)-OPT approximations. Our algorithms are not hyperparameter-free: they achieve the desiderata only assuming algorithm's hyperparameters are known a priori---or are at least approximable. I.e., our theory indicates what problem quantities need to be known, in order to get a good solution within polynomial time, and does not contradict to recent inapproximabilty results, as in [46].

READ FULL TEXT
research
11/01/2021

Improved Algorithms for Low Rank Approximation from Sparsity

We overcome two major bottlenecks in the study of low rank approximation...
research
12/02/2022

On the optimal rank-1 approximation of matrices in the Chebyshev norm

The problem of low rank approximation is ubiquitous in science. Traditio...
research
10/10/2016

Low-Rank Dynamic Mode Decomposition: Optimal Solution in Polynomial-Time

This work studies the linear approximation of high-dimensional dynamical...
research
08/20/2016

Visual Processing by a Unified Schatten-p Norm and ℓ_q Norm Regularized Principal Component Pursuit

In this paper, we propose a non-convex formulation to recover the authen...
research
08/12/2022

A Practical Second-order Latent Factor Model via Distributed Particle Swarm Optimization

Latent Factor (LF) models are effective in representing high-dimension a...
research
02/27/2013

Missing Entries Matrix Approximation and Completion

We describe several algorithms for matrix completion and matrix approxim...
research
08/14/2018

A Comprehensive Survey for Low Rank Regularization

Low rank regularization, in essence, involves introducing a low rank or ...

Please sign up or login with your details

Forgot password? Click here to reset