Mixed-Projection Conic Optimization: A New Paradigm for Modeling Rank Constraints

09/22/2020
by   Dimitris Bertsimas, et al.
0

We propose a framework for modeling and solving low-rank optimization problems to certifiable optimality. We introduce symmetric projection matrices that satisfy Y^2=Y, the matrix analog of binary variables that satisfy z^2=z, to model rank constraints. By leveraging regularization and strong duality, we prove that this modeling paradigm yields tractable convex optimization problems over the non-convex set of orthogonal projection matrices. Furthermore, we design outer-approximation algorithms to solve low-rank problems to certifiable optimality, compute lower bounds via their semidefinite relaxations, and provide near optimal solutions through rounding and local search techniques. We implement these numerical ingredients and, for the first time, solve low-rank optimization problems to certifiable optimality. Our algorithms also supply certifiably near-optimal solutions for larger problem sizes and outperform existing heuristics, by deriving an alternative to the popular nuclear norm relaxation which generalizes the perspective relaxation from vectors to matrices. All in all, our framework, which we name Mixed-Projection Conic Optimization, solves low-rank problems to certifiable optimality in a tractable and unified fashion.

READ FULL TEXT

page 27

page 28

page 29

research
08/04/2011

Convex Optimization without Projection Steps

For the general problem of minimizing a convex function over a compact c...
research
05/12/2021

A new perspective on low-rank optimization

A key question in many low-rank problems throughout optimization, machin...
research
06/06/2016

Low-rank Optimization with Convex Constraints

The problem of low-rank approximation with convex constraints, which oft...
research
02/22/2017

Sketchy Decisions: Convex Low-Rank Matrix Optimization with Optimal Storage

This paper concerns a fundamental class of convex matrix optimization pr...
research
09/11/2018

Simple single-scale microstructures based on optimal rank-3 laminates

With the goal of identifying optimal elastic single-scale microstructure...
research
06/05/2018

A Projection Method for Metric-Constrained Optimization

We outline a new approach for solving optimization problems which enforc...
research
08/12/2019

Near-optimal Robust Bilevel Optimization

Bilevel optimization studies problems where the optimal response to a se...

Please sign up or login with your details

Forgot password? Click here to reset