Proximal algorithms for constrained composite optimization, with applications to solving low-rank SDPs

03/01/2019
by   Yu Bai, et al.
0

We study a family of (potentially non-convex) constrained optimization problems with convex composite structure. Through a novel analysis of non-smooth geometry, we show that proximal-type algorithms applied to exact penalty formulations of such problems exhibit local linear convergence under a quadratic growth condition, which the compositional structure we consider ensures. The main application of our results is to low-rank semidefinite optimization with Burer-Monteiro factorizations. We precisely identify the conditions for quadratic growth in the factorized problem via structures in the semidefinite problem, which could be of independent interest for understanding matrix factorization.

READ FULL TEXT
research
03/29/2023

An inexact linearized proximal algorithm for a class of DC composite optimization problems and applications

This paper is concerned with a class of DC composite optimization proble...
research
10/11/2017

Local Convergence of Proximal Splitting Methods for Rank Constrained Problems

We analyze the local convergence of proximal splitting algorithms to sol...
research
03/01/2018

Smoothed analysis for low-rank solutions to semidefinite programs in quadratic penalty form

Semidefinite programs (SDP) are important in learning and combinatorial ...
research
05/12/2021

A new perspective on low-rank optimization

A key question in many low-rank problems throughout optimization, machin...
research
09/27/2018

Fast Stochastic Algorithms for Low-rank and Nonsmooth Matrix Problems

Composite convex optimization problems which include both a nonsmooth te...
research
03/01/2023

Composite Optimization Algorithms for Sigmoid Networks

In this paper, we use composite optimization algorithms to solve sigmoid...
research
07/07/2022

The effect of smooth parametrizations on nonconvex optimization landscapes

We develop new tools to study the landscapes of nonconvex optimization p...

Please sign up or login with your details

Forgot password? Click here to reset