Provable Burer-Monteiro factorization for a class of norm-constrained matrix problems

06/04/2016
by   Dohyung Park, et al.
0

We study the projected gradient descent method on low-rank matrix problems with a strongly convex objective. We use the Burer-Monteiro factorization approach to implicitly enforce low-rankness; such factorization introduces non-convexity in the objective. We focus on constraint sets that include both positive semi-definite (PSD) constraints and specific matrix norm-constraints. Such criteria appear in quantum state tomography and phase retrieval applications. We show that non-convex projected gradient descent favors local linear convergence in the factored space. We build our theory on a novel descent lemma, that non-trivially extends recent results on the unconstrained problem. The resulting algorithm is Projected Factored Gradient Descent, abbreviated as ProjFGD, and shows superior performance compared to state of the art on quantum state tomography and sparse phase retrieval applications.

READ FULL TEXT

page 10

page 11

research
06/27/2021

Global Convergence of Gradient Descent for Asymmetric Low-Rank Matrix Factorization

We study the asymmetric low-rank factorization problem: min_𝐔∈ℝ^m ×...
research
08/01/2022

Gradient-descent quantum process tomography by learning Kraus operators

We perform quantum process tomography (QPT) for both discrete- and conti...
research
01/27/2022

Benchmarking learned non-Cartesian k-space trajectories and reconstruction networks

We benchmark the current existing methods to jointly learn non-Cartesian...
research
07/28/2022

A Recommender System for Equitable Public Art Curation and Installation

The placement of art in public spaces can have a significant impact on w...
research
02/10/2019

Multi-Dimensional Balanced Graph Partitioning via Projected Gradient Descent

Motivated by performance optimization of large-scale graph processing sy...
research
12/22/2021

On Asymptotic Linear Convergence of Projected Gradient Descent for Constrained Least Squares

Many recent problems in signal processing and machine learning such as c...
research
06/01/2018

Run Procrustes, Run! On the convergence of accelerated Procrustes Flow

In this work, we present theoretical results on the convergence of non-c...

Please sign up or login with your details

Forgot password? Click here to reset