Nonmonotone Local Minimax Methods for Finding Multiple Saddle Points

09/04/2021
by   Wei Liu, et al.
0

In this paper, combining normalized nonmonotone search strategies with the Barzilai–Borwein-type step-size, a novel local minimax method (LMM), which is globally convergent, is proposed to find multiple (unstable) saddle points of nonconvex functionals in Hilbert spaces. Compared to traditional LMMs, this approach does not require the strict decrease of the objective functional value at each iterative step. Firstly, by introducing two kinds of normalized nonmonotone step-size search strategies to replace normalized monotone decrease conditions adopted in traditional LMMs, two types of nonmonotone LMMs are constructed. Their feasibility and convergence results are rigorously carried out. Secondly, in order to speed up the convergence of the nonmonotone LMMs, a globally convergent Barzilai–Borwein-type LMM (GBBLMM) is presented by explicitly constructing the Barzilai–Borwein-type step-size as a trial step-size of the normalized nonmonotone step-size search strategy in each iteration. Finally, the GBBLMM is implemented to find multiple unstable solutions of two classes of semilinear elliptic boundary value problems with variational structures: one is the semilinear elliptic equations with the homogeneous Dirichlet boundary condition and another is the linear elliptic equations with semilinear Neumann boundary conditions. Extensive numerical results indicate that our approach is very effective and speeds up the LMM significantly.

READ FULL TEXT

page 23

page 24

research
08/11/2021

Normalized Wolfe-Powell-type Local Minimax Method for Finding Multiple Unstable Solutions of Nonlinear Elliptic PDEs

The local minimax method (LMM) proposed in [Y. Li and J. Zhou, SIAM J. S...
research
05/10/2023

Error Analysis of Mixed Residual Methods for Elliptic Equations

We present a rigorous theoretical analysis of the convergence rate of th...
research
02/17/2010

Iterative exact global histogram specification and SSIM gradient ascent: a proof of convergence, step size and parameter selection

The SSIM-optimized exact global histogram specification (EGHS) is shown ...
research
09/12/2021

Can 4th-order compact schemes exist for flux type BCs?

In this paper new innovative fourth order compact schemes for Robin and ...
research
06/22/2023

Don't be so Monotone: Relaxing Stochastic Line Search in Over-Parameterized Models

Recent works have shown that line search methods can speed up Stochastic...
research
11/24/2022

Online Regularized Learning Algorithm for Functional Data

In recent years, functional linear models have attracted growing attenti...
research
03/05/2020

In-flight range optimization of multicopters using multivariable extremum seeking with adaptive step size

Limited flight range is a common problem for multicopters. To alleviate ...

Please sign up or login with your details

Forgot password? Click here to reset