Momentum Accelerated Multigrid Methods

06/30/2020
by   Chunyan Niu, et al.
0

In this paper, we propose two momentum accelerated MG cycles. The main idea is to rewrite the linear systems as optimization problems and apply momentum accelerations, e.g., the heavy ball and Nesterov acceleration methods, to define the coarse-level solvers for multigrid (MG) methods. The resulting MG cycles, which we call them H-cycle (uses heavy ball method) and N-cycle (uses Nesterov acceleration), share the advantages of both algebraic multilevel iteration (AMLI)- and K-cycle (a nonlinear version of the AMLI-cycle). Namely, similar to the K-cycle, our H- and N-cycle do not require the estimation of extreme eigenvalues while the computational cost is the same as AMLI-cycle. Theoretical analysis shows that the momentum accelerated cycles are essentially special AMLI-cycle methods and, thus, they are uniformly convergent under standard assumptions. Finally, we present numerical experiments to verify the theoretical results and demonstrate the efficiency of H- and N-cycle.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/28/2023

Minimal error momentum Bregman-Kaczmarz

The Bregman-Kaczmarz method is an iterative method which can solve stron...
research
06/15/2022

On the fast convergence of minibatch heavy ball momentum

Simple stochastic momentum methods are widely used in machine learning o...
research
06/19/2020

How Does Momentum Help Frank Wolfe?

We unveil the connections between Frank Wolfe (FW) type algorithms and t...
research
04/05/2023

Accelerated high-cycle phase field fatigue predictions

Phase field fracture models have seen widespread application in the last...
research
10/08/2021

Heavy Ball Momentum for Conditional Gradient

Conditional gradient, aka Frank Wolfe (FW) algorithms, have well-documen...
research
05/18/2020

Context-aware and Scale-insensitive Temporal Repetition Counting

Temporal repetition counting aims to estimate the number of cycles of a ...
research
07/13/2022

AdamNODEs: When Neural ODE Meets Adaptive Moment Estimation

Recent work by Xia et al. leveraged the continuous-limit of the classica...

Please sign up or login with your details

Forgot password? Click here to reset