Regularization for Matrix Completion

01/02/2010
by   Raghunandan H. Keshavan, et al.
0

We consider the problem of reconstructing a low rank matrix from noisy observations of a subset of its entries. This task has applications in statistical learning, computer vision, and signal processing. In these contexts, "noise" generically refers to any contribution to the data that is not captured by the low-rank model. In most applications, the noise level is large compared to the underlying signal and it is important to avoid overfitting. In order to tackle this problem, we define a regularized cost function well suited for spectral reconstruction methods. Within a random noise model, and in the large system limit, we prove that the resulting accuracy undergoes a phase transition depending on the noise level and on the fraction of observed entries. The cost function can be minimized using OPTSPACE (a manifold gradient descent algorithm). Numerical simulations show that this approach is competitive with state-of-the-art alternatives.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/18/2020

Robust Low-rank Matrix Completion via an Alternating Manifold Proximal Gradient Continuation Method

Robust low-rank matrix completion (RMC), or robust principal component a...
research
01/21/2021

Robust spectral compressive sensing via vanilla gradient descent

This paper investigates robust recovery of an undamped or damped spectra...
research
05/25/2021

Rank-one matrix estimation: analytic time evolution of gradient descent dynamics

We consider a rank-one symmetric matrix corrupted by additive noise. The...
research
09/15/2015

Exponential Family Matrix Completion under Structural Constraints

We consider the matrix completion problem of recovering a structured mat...
research
10/22/2021

Uncertainty Quantification For Low-Rank Matrix Completion With Heterogeneous and Sub-Exponential Noise

The problem of low-rank matrix completion with heterogeneous and sub-exp...
research
06/20/2023

The Dyson Equalizer: Adaptive Noise Stabilization for Low-Rank Signal Detection and Recovery

Detecting and recovering a low-rank signal in a noisy data matrix is a f...
research
10/23/2020

Adversarial Crowdsourcing Through Robust Rank-One Matrix Completion

We consider the problem of reconstructing a rank-one matrix from a revea...

Please sign up or login with your details

Forgot password? Click here to reset