The Impact of Noise on Evaluation Complexity: The Deterministic Trust-Region Case

04/06/2021
by   Stefania Bellavia, et al.
0

Intrinsic noise in objective function and derivatives evaluations may cause premature termination of optimization algorithms. Evaluation complexity bounds taking this situation into account are presented in the framework of a deterministic trust-region method. The results show that the presence of intrinsic noise may dominate these bounds, in contrast with what is known for methods in which the inexactness in function and derivatives' evaluations is fully controllable. Moreover, the new analysis provides estimates of the optimality level achievable, should noise cause early termination. It finally sheds some light on the impact of inexact computer arithmetic on evaluation complexity.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/09/2018

Deterministic and stochastic inexact regularization algorithms for nonconvex optimization with optimal complexity

A regularization algorithm using inexact function values and inexact der...
research
11/09/2018

Adaptive Regularization Algorithms with Inexact Evaluations for Nonconvex Optimization

A regularization algorithm using inexact function values and inexact der...
research
11/09/2018

Deterministic and stochastic inexact regularization algorithms for nonconvex ptimization with optimal complexity

A regularization algorithm using inexact function values and inexact der...
research
11/03/2018

Sharp worst-case evaluation complexity bounds for arbitrary-order nonconvex optimization with inexpensive constraints

We provide sharp worst-case evaluation complexity bounds for nonconvex m...
research
03/03/2022

Parametric complexity analysis for a class of first-order Adagrad-like algorithms

A class of algorithms for optimization in the presence of noise is prese...
research
10/15/2020

Solving Trust Region Subproblems Using Riemannian Optimization

The Trust Region Subproblem is a fundamental optimization problem that t...
research
02/14/2023

Multilevel Objective-Function-Free Optimization with an Application to Neural Networks Training

A class of multi-level algorithms for unconstrained nonlinear optimizati...

Please sign up or login with your details

Forgot password? Click here to reset