Single-pass Nyström approximation in mixed precision

05/26/2022
by   Erin Carson, et al.
0

Low rank matrix approximations appear in a number of scientific computing applications. We consider the Nyström method for approximating a positive semidefinite matrix A. The computational cost of its single-pass version can be decreased by running it in mixed precision, where the expensive products with A are computed in a lower than the working precision. We bound the extra finite precision error which is compared to the error of the Nyström approximation in exact arithmetic and identify when the approximation quality is not affected by the low precision computations. The mixed precision Nyström method can be used to inexpensively construct a limited memory preconditioner for the conjugate gradient method. We bound the condition number of the preconditioned coefficient matrix, and experimentally show that such preconditioner can be effective.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/01/2020

Mixed precision matrix interpolative decompositions for model reduction

Renewed interest in mixed-precision algorithms has emerged due to growin...
research
12/12/2019

Mixed-Precision analysis of Householder QR Algorithms

Although mixed precision arithmetic has recently garnered interest for t...
research
03/21/2023

The stability of split-preconditioned FGMRES in four precisions

We consider the split-preconditioned FGMRES method in a mixed precision ...
research
10/01/2020

Computing the matrix sine and cosine simultaneously with a reduced number of products

A new procedure is presented for computing the matrix cosine and sine si...
research
06/17/2021

How Low Can We Go: Trading Memory for Error in Low-Precision Training

Low-precision arithmetic trains deep learning models using less energy, ...
research
10/30/2019

Effect of Mixed Precision Computing on H-Matrix Vector Multiplication in BEM Analysis

Hierarchical Matrix (H-matrix) is an approximation technique which split...
research
07/18/2023

Leveraging Mixed Precision in Exponential Time Integration Methods

The machine learning explosion has created a prominent trend in modern c...

Please sign up or login with your details

Forgot password? Click here to reset