DeepAI AI Chat
Log In Sign Up

An Explicit Convergence Rate for Nesterov's Method from SDP

01/13/2018
by   Sam Safavi, et al.
Tufts University
VERIMAG
Boston College
Johns Hopkins University
0

The framework of Integral Quadratic Constraints (IQC) introduced by Lessard et al. (2014) reduces the computation of upper bounds on the convergence rate of several optimization algorithms to semi-definite programming (SDP). In particular, this technique was applied to Nesterov's accelerated method (NAM). For quadratic functions, this SDP was explicitly solved leading to a new bound on the convergence rate of NAM, and for arbitrary strongly convex functions it was shown numerically that IQC can improve bounds from Nesterov (2004). Unfortunately, an explicit analytic solution to the SDP was not provided. In this paper, we provide such an analytical solution, obtaining a new general and explicit upper bound on the convergence rate of NAM, which we further optimize over its parameters. To the best of our knowledge, this is the best, and explicit, upper bound on the convergence rate of NAM for strongly convex functions.

READ FULL TEXT

page 1

page 2

page 3

page 4

12/07/2015

An Explicit Rate Bound for the Over-Relaxed ADMM

The framework of Integral Quadratic Constraints of Lessard et al. (2014)...
01/01/2021

On a Faster R-Linear Convergence Rate of the Barzilai-Borwein Method

The Barzilai-Borwein (BB) method has demonstrated great empirical succes...
01/31/2019

Tight bounds on the convergence rate of generalized ratio consensus algorithms

The problems discussed in this paper are motivated by the ratio consensu...
08/13/2020

Explicit and recursive estimates of the Lambert W function

Solutions to a wide variety of transcendental equations can be expressed...
03/10/2017

Tuning Over-Relaxed ADMM

The framework of Integral Quadratic Constraints (IQC) reduces the comput...
09/23/2020

A Unified Analysis of First-Order Methods for Smooth Games via Integral Quadratic Constraints

The theory of integral quadratic constraints (IQCs) allows the certifica...