Riemannian Perspective on Matrix Factorization

02/01/2021
by   Kwangjun Ahn, et al.
0

We study the non-convex matrix factorization approach to matrix completion via Riemannian geometry. Based on an optimization formulation over a Grassmannian manifold, we characterize the landscape based on the notion of principal angles between subspaces. For the fully observed case, our results show that there is a region in which the cost is geodesically convex, and outside of which all critical points are strictly saddle. We empirically study the partially observed case based on our findings.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/27/2017

Optimal Sample Complexity for Matrix Completion and Related Problems via ℓ_2-Regularization

We study the strong duality of non-convex matrix factorization: we show ...
research
03/13/2022

On the analysis of optimization with fixed-rank matrices: a quotient geometric view

We study a type of Riemannian gradient descent (RGD) algorithm, designed...
research
09/12/2016

Non-square matrix sensing without spurious local minima via the Burer-Monteiro approach

We consider the non-square matrix sensing problem, under restricted isom...
research
07/11/2019

The Landscape of Non-convex Empirical Risk with Degenerate Population Risk

The landscape of empirical risk has been widely studied in a series of m...
research
10/22/2022

Deep Linear Networks for Matrix Completion – An Infinite Depth Limit

The deep linear network (DLN) is a model for implicit regularization in ...
research
06/29/2019

Approximate matrix completion based on cavity method

In order to solve large matrix completion problems with practical comput...

Please sign up or login with your details

Forgot password? Click here to reset