Towards Riemannian Accelerated Gradient Methods

06/07/2018
by   Hongyi Zhang, et al.
0

We propose a Riemannian version of Nesterov's Accelerated Gradient algorithm (RAGD), and show that for geodesically smooth and strongly convex problems, within a neighborhood of the minimizer whose radius depends on the condition number as well as the sectional curvature of the manifold, RAGD converges to the minimizer with acceleration. Unlike the algorithm in (Liu et al., 2017) that requires the exact solution to a nonlinear equation which in turn may be intractable, our algorithm is constructive and computationally tractable. Our proof exploits a new estimate sequence and a novel bound on the nonlinear metric distortion, both ideas may be of independent interest.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/24/2020

From Nesterov's Estimate Sequence to Riemannian Acceleration

We propose the first global accelerated gradient method for Riemannian m...
research
11/04/2021

A Riemannian Accelerated Proximal Extragradient Framework and its Implications

The study of accelerated gradient methods in Riemannian optimization has...
research
05/25/2023

Accelerated Methods for Riemannian Min-Max Optimization Ensuring Bounded Geometric Penalties

In this work, we study optimization problems of the form min_x max_y f(x...
research
02/07/2022

Nesterov Accelerated Shuffling Gradient Method for Convex Optimization

In this paper, we propose Nesterov Accelerated Shuffling Gradient (NASG)...
research
11/10/2018

R-SPIDER: A Fast Riemannian Stochastic Optimization Algorithm with Curvature Independent Rate

We study smooth stochastic optimization problems on Riemannian manifolds...
research
05/31/2018

On Curvature-aided Incremental Aggregated Gradient Methods

This paper studies an acceleration technique for incremental aggregated ...
research
02/22/2022

Acceleration of Gossip Algorithms through the Euler-Poisson-Darboux Equation

Gossip algorithms and their accelerated versions have been studied exclu...

Please sign up or login with your details

Forgot password? Click here to reset