The conjugate gradient method with various viewpoints

10/08/2019
by   Xuping Zhang, et al.
0

Connections of the conjugate gradient (CG) method with other methods in computational mathematics are surveyed, including the connections with the conjugate direction method, the subspace optimization method and the quai-Newton method BFGS in numrical optimization, and the Lanczos method in numerical linear algebra. Two sequences of polynomials related to residual vectors and conjugate vectors are reviewed, where the residual polynomials are similar to orthogonal polynomials in the approximation theory and the roots of the polynomials reveal certain information of the coefficient matrix. The convergence rates of the steepest descent and CG are reconsidered in a viewpoint different from textbooks. The connection of infinite dimensional CG with finite dimensional preconditioned CG is also reviewed via numerical solution of an elliptic equation.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/12/2016

Algorithmic computation of polynomial amoebas

We present algorithms for computation and visualization of amoebas, thei...
research
02/16/2023

Polynomial and rational measure modifications of orthogonal polynomials via infinite-dimensional banded matrix factorizations

We describe fast algorithms for approximating the connection coefficient...
research
04/21/2020

Fast and accurate evaluation of dual Bernstein polynomials

Dual Bernstein polynomials find many applications in approximation theor...
research
12/23/2021

Hermite–Padé approximations with Pfaffian structures: Novikov peakon equation and integrable lattices

Motivated by the Novikov equation and its peakon problem, we propose a n...
research
03/24/2023

Chebyshev and Equilibrium Measure Vs Bernstein and Lebesgue Measure

We show that Bernstein polynomials are related to the Lebesgue measure o...
research
03/28/2023

Continued fractions and orthogonal polynomials in several variables

We extend the close interplay between continued fractions, orthogonal po...

Please sign up or login with your details

Forgot password? Click here to reset