The convergence of the Generalized Lanczos Trust-Region Method for the Trust-Region Subproblem

08/06/2019
by   Zhongxiao Jia, et al.
0

Solving the trust-region subproblem (TRS) plays a key role in numerical optimization and many other applications. The generalized Lanczos trust-region (GLTR) method is a well-known Lanczos type approach for solving a large-scale TRS. The method projects the original large-scale TRS onto a k dimensional Krylov subspace, whose orthonormal basis is generated by the symmetric Lanczos process, and computes an approximate solution from the underlying subspace. There have been some a-priori error bounds for the optimal solution and the optimal objective value in the literature, but no a-priori result exists on the convergence of Lagrangian multipliers involved in projected TRS's and the residual norm of approximate solution. In this paper, a general convergence theory of the GLTR method is established, and a-priori bounds are derived for the errors of the optimal Lagrangian multiplier, the optimal solution, the optimal objective value and the residual norm of approximate solution. Numerical experiments demonstrate that our bounds are realistic and predict the convergence rates of the three errors and residual norms accurately.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/19/2021

A comparison of eigenvalue-based algorithms and the generalized Lanczos trust-region algorithm for Solving the trust-region subproblem

Solving the trust-region subproblem (TRS) plays a key role in numerical ...
research
12/27/2021

Implicit regularity and linear convergence rates for the generalized trust-region subproblem

In this paper we develop efficient first-order algorithms for the genera...
research
01/27/2021

Krylov-Simplex method that minimizes the residual in ℓ_1-norm or ℓ_∞-norm

The paper presents two variants of a Krylov-Simplex iterative method tha...
research
11/24/2015

Generalized Conjugate Gradient Methods for ℓ_1 Regularized Convex Quadratic Programming with Finite Convergence

The conjugate gradient (CG) method is an efficient iterative method for ...
research
12/06/2022

First-order perturbation theory of trust-region subproblems

Trust-region subproblem (TRS) is an important problem arising in many ap...
research
08/24/2020

A Meshfree Generalized Finite Difference Method for Solution Mining Processes

Experimental and field investigations for solution mining processes have...
research
11/11/2020

Range-relaxed criteria for choosing the Lagrange multipliers in the Levenberg-Marquardt method

In this article we propose a novel strategy for choosing the Lagrange mu...

Please sign up or login with your details

Forgot password? Click here to reset