A Faster Interior-Point Method for Sum-of-Squares Optimization

02/17/2022
by   Shunhua Jiang, et al.
0

We present a faster interior-point method for optimizing sum-of-squares (SOS) polynomials, which are a central tool in polynomial optimization and capture convex programming in the Lasserre hierarchy. Let p = ∑_i q^2_i be an n-variate SOS polynomial of degree 2d. Denoting by L := n+dd and U := n+2d2d the dimensions of the vector spaces in which q_i's and p live respectively, our algorithm runs in time Õ(LU^1.87). This is polynomially faster than state-of-art SOS and semidefinite programming solvers, which achieve runtime Õ(L^0.5min{U^2.37, L^4.24}). The centerpiece of our algorithm is a dynamic data structure for maintaining the inverse of the Hessian of the SOS barrier function under the polynomial interpolant basis, which efficiently extends to multivariate SOS optimization, and requires maintaining spectral approximations to low-rank perturbations of elementwise (Hadamard) products. This is the main challenge and departure from recent IPM breakthroughs using inverse-maintenance, where low-rank updates to the slack matrix readily imply the same for the Hessian matrix.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/16/2020

Faster Dynamic Matrix Inverse for Faster LPs

Motivated by recent Linear Programming solvers, we design dynamic data s...
research
12/08/2019

The AZ algorithm for least squares systems with a known incomplete generalized inverse

We introduce an algorithm for the least squares solution of a rectangula...
research
07/07/2021

Efficient Matrix-Free Approximations of Second-Order Information, with Applications to Pruning and Optimization

Efficiently approximating local curvature information of the loss functi...
research
09/27/2017

On the construction of converging hierarchies for polynomial optimization based on certificates of global positivity

In recent years, techniques based on convex optimization and real algebr...
research
03/05/2022

A Robust Spectral Algorithm for Overcomplete Tensor Decomposition

We give a spectral algorithm for decomposing overcomplete order-4 tensor...
research
08/25/2018

An Experimental Comparison of SONC and SOS Certificates for Unconstrained Optimization

Finding the minimum of a multivariate real polynomial is a well-known ha...
research
08/24/2020

Approximate Cross-Validation with Low-Rank Data in High Dimensions

Many recent advances in machine learning are driven by a challenging tri...

Please sign up or login with your details

Forgot password? Click here to reset