Sharp Restricted Isometry Bounds for the Inexistence of Spurious Local Minima in Nonconvex Matrix Recovery

01/07/2019
by   Richard Y. Zhang, et al.
0

Nonconvex matrix recovery is known to contain no spurious local minima under a restricted isometry property (RIP) with a sufficiently small RIP constant δ. If δ is too large, however, then counterexamples containing spurious local minima are known to exist. In this paper, we introduce a proof technique that is capable of establishing sharp thresholds on δ to guarantee the inexistence of spurious local minima. Using the technique, we prove that in the case of a rank-1 ground truth, an RIP constant of δ<1/2 is both necessary and sufficient for exact recovery from any arbitrary initial point (such as a random point). We also prove a local recovery result: given an initial point x_0 satisfying f(x_0)<(1-δ)^2f(0), any descent algorithm that converges to second-order optimality guarantees exact recovery.

READ FULL TEXT
research
04/21/2021

Sharp Global Guarantees for Nonconvex Low-Rank Matrix Recovery in the Overparameterized Regime

We prove that it is possible for nonconvex low-rank matrix recovery to c...
research
05/25/2018

How Much Restricted Isometry is Needed In Nonconvex Matrix Recovery?

When the linear measurements of an instance of low-rank matrix recovery ...
research
06/12/2020

How Many Samples is a Good Initial Point Worth?

Given a sufficiently large amount of labeled data, the non-convex low-ra...
research
05/18/2021

Sharp Restricted Isometry Property Bounds for Low-rank Matrix Recovery Problems with Corrupted Measurements

In this paper, we study a general low-rank matrix recovery problem with ...
research
03/08/2022

Noisy Low-rank Matrix Optimization: Geometry of Local Minima and Convergence Rate

This paper is concerned with low-rank matrix optimization, which has fou...
research
01/16/2023

Universal minima of potentials of certain spherical designs contained in the fewest parallel hyperplanes

We find the set of all universal minimum points of the potential of the ...
research
05/24/2023

ReSync: Riemannian Subgradient-based Robust Rotation Synchronization

This work presents ReSync, a Riemannian subgradient-based algorithm for ...

Please sign up or login with your details

Forgot password? Click here to reset