Multiplicative Updates for Online Convex Optimization over Symmetric Cones

07/06/2023
by   Ilayda Canyakmaz, et al.
0

We study online convex optimization where the possible actions are trace-one elements in a symmetric cone, generalizing the extensively-studied experts setup and its quantum counterpart. Symmetric cones provide a unifying framework for some of the most important optimization models, including linear, second-order cone, and semidefinite optimization. Using tools from the field of Euclidean Jordan Algebras, we introduce the Symmetric-Cone Multiplicative Weights Update (SCMWU), a projection-free algorithm for online optimization over the trace-one slice of an arbitrary symmetric cone. We show that SCMWU is equivalent to Follow-the-Regularized-Leader and Online Mirror Descent with symmetric-cone negative entropy as regularizer. Using this structural result we show that SCMWU is a no-regret algorithm, and verify our theoretical results with extensive experiments. Our results unify and generalize the analysis for the Multiplicative Weights Update method over the probability simplex and the Matrix Multiplicative Weights Update method over the set of density matrices.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/02/2021

Multiplicative updates for symmetric-cone factorizations

Given a matrix X∈ℝ^m× n_+ with non-negative entries, the cone factorizat...
research
02/05/2019

Exponentiated Gradient Meets Gradient Descent

The (stochastic) gradient descent and the multiplicative update method a...
research
02/13/2023

Achieving Better Regret against Strategic Adversaries

We study online learning problems in which the learner has extra knowled...
research
06/16/2015

Spectral Sparsification and Regret Minimization Beyond Matrix Multiplicative Updates

In this paper, we provide a novel construction of the linear-sized spect...
research
05/15/2019

Predictive Online Convex Optimization

We incorporate future information in the form of the estimated value of ...
research
05/22/2023

A Convex Optimization Framework for Regularized Geodesic Distances

We propose a general convex optimization problem for computing regulariz...
research
03/18/2020

Malicious Experts versus the multiplicative weights algorithm in online prediction

We consider a prediction problem with two experts and a forecaster. We a...

Please sign up or login with your details

Forgot password? Click here to reset