Lagrange Multipliers and Rayleigh Quotient Iteration in Constrained Type Equations

08/01/2019
by   Du Nguyen, et al.
0

We generalize the Rayleigh quotient iteration to a class of functions called vector Lagrangians. The Rayleigh quotient is an expression used in literature as an estimate of the Lagrange multiplier in constrained optimization. We discuss two methods of solving the updating equation associated with the iteration. One method leads to a generalization of Riemannian Newton method for embedded manifolds in a Euclidean space while the other leads to a generalization of the classical Rayleigh quotient formula and its invariant subspace extension. We also show how to apply second order iteration in this context to obtain cubic convergence. We discuss applications of this result to linear and nonlinear eigenvalue and subspace problems as well as potential applications in optimization.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/19/2023

Inexact Newton Methods for Solving Generalized Equations on Riemannian Manifolds

The local convergence of an inexact Newton method is studied for solving...
research
11/12/2019

Nonsmooth Optimization over Stiefel Manifold: Riemannian Subgradient Methods

Nonsmooth Riemannian optimization is a still under explored subfield of ...
research
02/21/2020

Stochastic Subspace Cubic Newton Method

In this paper, we propose a new randomized second-order optimization alg...
research
02/28/2020

Implicit algorithms for eigenvector nonlinearities

We study and derive algorithms for nonlinear eigenvalue problems, where ...
research
04/02/2018

Constrained Least Squares for Extended Complex Factor Analysis

For subspace estimation with an unknown colored noise, Factor Analysis (...
research
12/08/2020

Generalization of the Secant Method for Nonlinear Equations (extended version)

The secant method is a very effective numerical procedure used for solvi...
research
11/17/2021

Evaluations of The Hierarchical Subspace Iteration Method

This document contains additional experiments concerned with the evaluat...

Please sign up or login with your details

Forgot password? Click here to reset