Using gradient directions to get global convergence of Newton-type methods

04/02/2020
by   Daniela di Serafino, et al.
0

The renewed interest in Steepest Descent (SD) methods following the work of Barzilai and Borwein [IMA Journal of Numerical Analysis, 8 (1988)] has driven us to consider a globalization strategy based on SD, which is applicable to any line-search method. In particular, we combine Newton-type directions with scaled SD steps to have suitable descent directions. Scaling the SD directions with a suitable step length makes a significant difference with respect to similar globalization approaches, in terms of both theoretical features and computational behavior. We apply our strategy to Newton's method and the BFGS method, with computational results that appear interesting compared with the results of well-established globalization strategies devised ad hoc for those methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/12/2022

Backtracking New Q-Newton's method: a good algorithm for optimization and solving systems of equations

In this paper, by combining the algorithm New Q-Newton's method - develo...
research
07/25/2023

Riemannian Newton methods for energy minimization problems of Kohn-Sham type

This paper is devoted to the numerical solution of constrained energy mi...
research
09/29/2018

A fast quasi-Newton-type method for large-scale stochastic optimisation

During recent years there has been an increased interest in stochastic a...
research
10/21/2021

Newton-Type Methods For Simultaneous Matrix Diagonalization

This paper proposes a Newton type method to solve numerically the eigenp...
research
04/30/2020

One-Step Estimation With Scaled Proximal Methods

We study statistical estimators computed using iterative optimization me...
research
08/17/2023

Dual Gauss-Newton Directions for Deep Learning

Inspired by Gauss-Newton-like methods, we study the benefit of leveragin...
research
08/11/2021

Normalized Wolfe-Powell-type Local Minimax Method for Finding Multiple Unstable Solutions of Nonlinear Elliptic PDEs

The local minimax method (LMM) proposed in [Y. Li and J. Zhou, SIAM J. S...

Please sign up or login with your details

Forgot password? Click here to reset