Modified memoryless spectral-scaling Broyden family on Riemannian manifolds

07/18/2023
by   Hiroyuki Sakai, et al.
0

This paper presents modified memoryless quasi-Newton methods based on the spectral-scaling Broyden family on Riemannian manifolds. The method involves adding one parameter to the search direction of the memoryless self-scaling Broyden family on the manifold. Moreover, it uses a general map instead of vector transport. This idea has already been proposed within a general framework of Riemannian conjugate gradient methods where one can use vector transport, scaled vector transport, or an inverse retraction. We show that the search direction satisfies the sufficient descent condition under some assumptions on the parameters. In addition, we show global convergence of the proposed method under the Wolfe conditions. We numerically compare it with existing methods, including Riemannian conjugate gradient methods and the memoryless spectral-scaling Broyden family. The numerical results indicate that the proposed method with the BFGS formula is suitable for solving an off-diagonal cost function minimization problem on an oblique manifold.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/27/2020

Spectral Residual Method for Nonlinear Equations on Riemannian Manifolds

In this paper, the spectral algorithm for nonlinear equations (SANE) is ...
research
06/15/2023

Optimization on product manifolds under a preconditioned metric

Since optimization on Riemannian manifolds relies on the chosen metric, ...
research
03/19/2023

Inexact Newton Methods for Solving Generalized Equations on Riemannian Manifolds

The local convergence of an inexact Newton method is studied for solving...
research
10/29/2021

A Riemannian Inexact Newton Dogleg Method for Constructing a Symmetric Nonnegative Matrix with Prescribed Spectrum

This paper is concerned with the inverse problem of constructing a symme...
research
06/14/2022

The Dynamics of Riemannian Robbins-Monro Algorithms

Many important learning algorithms, such as stochastic gradient methods,...
research
07/15/2022

Riemannian Natural Gradient Methods

This paper studies large-scale optimization problems on Riemannian manif...
research
06/24/2020

Riemannian Newton-CG Methods for Constructing a Positive Doubly Stochastic Matrix From Spectral Data

In this paper, we consider the inverse eigenvalue problem for the positi...

Please sign up or login with your details

Forgot password? Click here to reset