DeepAI AI Chat
Log In Sign Up

Convergence Analysis of a Cooperative Diffusion Gauss-Newton Strategy

by   Mou Wu, et al.
Central China Normal University
NetEase, Inc

In this paper, we investigate the convergence performance of a cooperative diffusion Gauss-Newton (GN) method, which is widely used to solve the nonlinear least squares problems (NLLS) due to the low computation cost compared with Newton's method. This diffusion GN collects the diversity of temporalspatial information over the network, which is used on local updates. In order to address the challenges on convergence analysis, we firstly consider to form a global recursion relation over spatial and temporal scales since the traditional GN is a time iterative method and the network-wide NLLS need to be solved. Secondly, the derived recursion related to the networkwide deviation between the successive two iterations is ambiguous due to the uncertainty of descent discrepancy in GN update step between two versions of cooperation and non-cooperation. Thus, an important work is to derive the boundedness conditions of this discrepancy. Finally, based on the temporal-spatial recursion relation and the steady-state equilibria theory for discrete dynamical systems, we obtain the sufficient conditions for algorithm convergence, which require the good initial guesses, reasonable step size values and network connectivity. Such analysis provides a guideline for the applications based on this diffusion GN method.


page 1

page 2

page 3

page 4


A local character based method for solving linear systems of radiation diffusion problems

The radiation diffusion problem is a kind of time-dependent nonlinear eq...

Provably Efficient Gauss-Newton Temporal Difference Learning Method with Function Approximation

In this paper, based on the spirit of Fitted Q-Iteration (FQI), we propo...

An Event-based Diffusion LMS Strategy

We consider a wireless sensor network consists of cooperative nodes, eac...

Global q-superlinear convergence of the infinite-dimensional Newton's method for the regularized p-Stokes equations

The motion of glaciers can be simulated with the p-Stokes equations. We ...

On the choice of initial guesses for the Newton-Raphson algorithm

The initialization of equation-based differential-algebraic system model...

All-at-once versus reduced iterative methods for time dependent inverse problems

In this paper we investigate all-at-once versus reduced regularization o...