Error bounds for overdetermined and underdetermined generalized centred simplex gradients

06/01/2020
by   Warren Hare, et al.
0

Using the Moore–Penrose pseudoinverse, this work generalizes the gradient approximation technique called centred simplex gradient to allow sample sets containing any number of points. This approximation technique is called the generalized centred simplex gradient. We develop error bounds and, under a full-rank condition, show that the error bounds have order O(Δ^2), where Δ is the radius of the sample set of points used. We establish calculus rules for generalized centred simplex gradients, introduce a calculus-based generalized centred simplex gradient and confirm that error bounds for this new approach are also order O(Δ^2). We provide several examples to illustrate the results and some benefits of these new methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/01/2021

Limiting behaviour of the generalized simplex gradient as the number of points tends to infinity on a fixed shape in R^n

This work investigates the asymptotic behaviour of the gradient approxim...
research
04/23/2021

Approximating the diagonal of a Hessian: which sample set of points should be used

An explicit formula to approximate the diagonal entries of the Hessian i...
research
10/07/2016

The Generalized Reparameterization Gradient

The reparameterization gradient has become a widely used method to obtai...
research
02/13/2022

Understanding Natural Gradient in Sobolev Spaces

While natural gradients have been widely studied from both theoretical a...
research
08/22/2017

Learning Combinations of Sigmoids Through Gradient Estimation

We develop a new approach to learn the parameters of regression models w...
research
09/12/2021

Gradients and Subgradients of Buffered Failure Probability

Gradients and subgradients are central to optimization and sensitivity a...
research
10/11/2018

Of Kernels and Queues: when network calculus meets analytic combinatorics

Stochastic network calculus is a tool for computing error bounds on the ...

Please sign up or login with your details

Forgot password? Click here to reset