Mixed Precision Iterative Refinement with Sparse Approximate Inverse Preconditioning

02/21/2022
by   Erin Carson, et al.
0

With the commercial availability of mixed precision hardware, mixed precision GMRES-based iterative refinement schemes have emerged as popular approaches for solving sparse linear systems. Existing analyses of these approaches, however, are all based on using a full LU factorization to construct preconditioners for use within GMRES in each refinement step. In practical applications, inexact preconditioning techniques, such as incomplete LU or sparse approximate inverses, are often used for performance reasons. In this work, we investigate the use of sparse approximate inverse preconditioners within GMRES-based iterative refinement. We analyze the computation of sparse approximate inverses in finite precision and derive constraints under which the user-specified stopping criteria will be satisfied. We then analyze the behavior of and convergence constraints for a GMRES-based iterative refinement scheme that uses sparse approximate inverse preconditioning, which we call SPAI-GMRES-IR. Our numerical experiments confirm that in some cases, sparse approximate inverse preconditioning can have an advantage over using a full LU factorization.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/08/2023

Mixed Precision Iterative Refinement with Adaptive Precision Sparse Approximate Inverse Preconditioning

Hardware trends have motivated the development of mixed precision algo-r...
research
01/24/2022

Mixed Precision GMRES-based Iterative Refinement with Recycling

With the emergence of mixed precision capabilities in hardware, iterativ...
research
07/13/2021

Multistage Mixed Precision Iterative Refinement

Low precision arithmetic, in particular half precision (16-bit) floating...
research
09/14/2023

Stable iterative refinement algorithms for solving linear systems

Iterative refinement (IR) is a popular scheme for solving a linear syste...
research
06/18/2021

HIFIR: Hybrid Incomplete Factorization with Iterative Refinement for Preconditioning Ill-conditioned and Singular Systems

We introduce a software package called HIFIR for preconditioning sparse,...
research
09/02/2020

Approximate Generalized Inverses with Iterative Refinement for ε-Accurate Preconditioning of Singular Systems

We introduce a new class of preconditioners to enable flexible GMRES to ...
research
02/24/2023

A mixed precision LOBPCG algorithm

The locally optimal block preconditioned conjugate gradient (LOBPCG) alg...

Please sign up or login with your details

Forgot password? Click here to reset