DeepAI
Log In Sign Up

Revisiting Projection-free Online Learning: the Strongly Convex Case

10/15/2020
by   Dan Garber, et al.
0

Projection-free optimization algorithms, which are mostly based on the classical Frank-Wolfe method, have gained significant interest in the machine learning community in recent years due to their ability to handle convex constraints that are popular in many applications, but for which computing projections is often computationally impractical in high-dimensional settings, and hence prohibit the use of most standard projection-based methods. In particular, a significant research effort was put on projection-free methods for online learning. In this paper we revisit the Online Frank-Wolfe (OFW) method suggested by Hazan and Kale <cit.> and fill a gap that has been left unnoticed for several years: OFW achieves a faster rate of O(T^2/3) on strongly convex functions (as opposed to the standard O(T^3/4) for convex but not strongly convex functions), where T is the sequence length. This is somewhat surprising since it is known that for offline optimization, in general, strong convexity does not lead to faster rates for Frank-Wolfe. We also revisit the bandit setting under strong convexity and prove a similar bound of Õ(T^2/3) (instead of O(T^3/4) without strong convexity). Hence, in the current state-of-affairs, the best projection-free upper-bounds for the full-information and bandit settings with strongly convex and nonsmooth functions match, up to logarithmic factors, in T.

READ FULL TEXT

page 1

page 2

page 3

page 4

10/08/2019

Improved Regret Bounds for Projection-free Bandit Convex Optimization

We revisit the challenge of designing online algorithms for the bandit c...
05/20/2018

Projection-Free Algorithms in Statistical Estimation

Frank-Wolfe algorithm (FW) and its variants have gained a surge of inter...
01/30/2020

Faster Projection-free Online Learning

In many online learning problems the computational bottleneck for gradie...
03/20/2021

Projection-free Distributed Online Learning with Strongly Convex Losses

To efficiently solve distributed online learning problems with complicat...
02/09/2021

Local and Global Uniform Convexity Conditions

We review various characterizations of uniform convexity and smoothness ...
05/08/2019

SAdam: A Variant of Adam for Strongly Convex Functions

The Adam algorithm has become extremely popular for large-scale machine ...
02/12/2022

Adaptive Bandit Convex Optimization with Heterogeneous Curvature

We consider the problem of adversarial bandit convex optimization, that ...