Large-Scale Convex Minimization with a Low-Rank Constraint

06/08/2011
by   Shai Shalev-Shwartz, et al.
0

We address the problem of minimizing a convex function over the space of large matrices with low rank. While this optimization problem is hard in general, we propose an efficient greedy algorithm and derive its formal approximation guarantees. Each iteration of the algorithm involves (approximately) finding the left and right singular vectors corresponding to the largest singular value of a certain matrix, which can be calculated in linear time. This leads to an algorithm which can scale to large matrices arising in several applications such as matrix completion for collaborative filtering and robust low rank matrix approximation.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/21/2023

Low Rank Matrix Completion via Robust Alternating Minimization in Nearly Linear Time

Given a matrix M∈ℝ^m× n, the low rank matrix completion problem asks us ...
research
04/13/2018

On the detection of low rank matrices in the high-dimensional regime

We address the detection of a low rank n× ndeterministic matrix X_0 from...
research
11/04/2014

A random algorithm for low-rank decomposition of large-scale matrices with missing entries

A Random SubMatrix method (RSM) is proposed to calculate the low-rank de...
research
07/01/2014

Identifying Outliers in Large Matrices via Randomized Adaptive Compressive Sampling

This paper examines the problem of locating outlier columns in a large, ...
research
02/08/2017

Matrix Completion from O(n) Samples in Linear Time

We consider the problem of reconstructing a rank-k n × n matrix M from a...
research
11/17/2021

A quantum-inspired algorithm for approximating statistical leverage scores

Suppose a matrix A ∈ℝ^m × n of rank k with singular value decomposition ...
research
03/18/2017

Spectrum Estimation from a Few Entries

Singular values of a data in a matrix form provide insights on the struc...

Please sign up or login with your details

Forgot password? Click here to reset