On the Partial Convexification for Low-Rank Spectral Optimization: Rank Bounds and Algorithms

05/12/2023
by   Yongchun Li, et al.
0

A Low-rank Spectral Optimization Problem (LSOP) minimizes a linear objective subject to multiple two-sided linear matrix inequalities intersected with a low-rank and spectral constrained domain set. Although solving LSOP is, in general, NP-hard, its partial convexification (i.e., replacing the domain set by its convex hull) termed "LSOP-R," is often tractable and yields a high-quality solution. This motivates us to study the strength of LSOP-R. Specifically, we derive rank bounds for any extreme point of the feasible set of LSOP-R and prove their tightness for the domain sets with different matrix spaces. The proposed rank bounds recover two well-known results in the literature from a fresh angle and also allow us to derive sufficient conditions under which the relaxation LSOP-R is equivalent to the original LSOP. To effectively solve LSOP-R, we develop a column generation algorithm with a vector-based convex pricing oracle, coupled with a rank-reduction algorithm, which ensures the output solution satisfies the theoretical rank bound. Finally, we numerically verify the strength of the LSOP-R and the efficacy of the proposed algorithms.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/28/2022

On the Exactness of Dantzig-Wolfe Relaxation for Rank Constrained Optimization Problems

This paper studies the rank constrained optimization problem (RCOP) that...
research
04/22/2019

Low-Rank Approximation from Communication Complexity

In low-rank approximation with missing entries, given A∈R^n× n and binar...
research
11/16/2019

Regularized Weighted Low Rank Approximation

The classical low rank approximation problem is to find a rank k matrix ...
research
12/17/2020

Rank-One Measurements of Low-Rank PSD Matrices Have Small Feasible Sets

We study the role of the constraint set in determining the solution to l...
research
05/07/2012

Graph Prediction in a Low-Rank and Autoregressive Setting

We study the problem of prediction for evolving graph data. We formulate...
research
09/26/2021

Sparse Plus Low Rank Matrix Decomposition: A Discrete Optimization Approach

We study the Sparse Plus Low Rank decomposition problem (SLR), which is ...
research
08/18/2018

Exact Passive-Aggressive Algorithms for Learning to Rank Using Interval Labels

In this paper, we propose exact passive-aggressive (PA) online algorithm...

Please sign up or login with your details

Forgot password? Click here to reset