Nonmonotone Globalization for Anderson Acceleration Using Adaptive Regularization

06/03/2020
by   Wenqing Ouyang, et al.
0

Anderson acceleration (AA) is a popular method for accelerating fixed-point iterations, but may suffer from instability and stagnation. We propose a globalization method for AA to improve its stability and achieve global and local convergence. Unlike existing AA globalization approaches that often rely on safeguarding operations and might hinder fast local convergence, we adopt a nonmonotone trust-region framework and introduce an adaptive quadratic regularization together with a tailored acceptance mechanism. We prove global convergence and show that our algorithm attains the same local convergence as AA under appropriate assumptions. The effectiveness of our method is demonstrated in several numerical experiments.

READ FULL TEXT
research
02/28/2020

Convergence analysis of adaptive DIIS algorithms with application to electronic ground state calculations

This paper deals with a general class of algorithms for the solution of ...
research
10/18/2019

Anderson Acceleration of Proximal Gradient Methods

Anderson acceleration is a well-established and simple technique for spe...
research
05/27/2018

Fast K-Means Clustering with Anderson Acceleration

We propose a novel method to accelerate Lloyd's algorithm for K-Means cl...
research
11/10/2016

Error concealment by means of motion refinement and regularized Bregman divergence

This work addresses the problem of error concealment in video transmissi...
research
05/15/2018

Anderson Acceleration for Geometry Optimization and Physics Simulation

Many computer graphics problems require computing geometric shapes subje...
research
08/25/2020

A family of fast fixed point iterations for M/G/1-type Markov chains

We consider the problem of computing the minimal nonnegative solution G ...
research
05/28/2019

Direct Nonlinear Acceleration

Optimization acceleration techniques such as momentum play a key role in...

Please sign up or login with your details

Forgot password? Click here to reset