A Probabilistic Numerical Extension of the Conjugate Gradient Method

08/07/2020
by   Tim W. Reid, et al.
0

We present a Conjugate Gradient (CG) implementation of the probabilistic numerical solver BayesCG, whose error estimates are a fully integrated design feature, easy to compute, and competitive with the best existing estimators. More specifically, we extend BayesCG to singular prior covariances, derive recursions for the posterior covariances, express the posteriors as projections, and establish that BayesCG retains the minimization properties over Krylov spaces regardless of the singular priors. We introduce a possibly singular Krylov prior covariance, under which the BayesCG posterior means coincide with the CG iterates and the posteriors can be computed efficiently. Because of its factored form, the Krylov prior is amenable to low-rank approximation, which produces an efficient BayesCG implementation as a CG method. We also introduce a probabilistic error estimator, the `S-statistic'. Although designed for sampling from BayesCG posteriors, its mean and variance under approximate Krylov priors can be computed with CG. An approximation of the S-statistic by a `95 percent credible interval' avoids the cost of sampling altogether. Numerical experiments illustrate that the resulting error estimates are competitive with the best existing methods and are easy to compute.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/08/2022

Statistical Properties of the Probabilistic Numeric Linear Solver BayesCG

We analyse the calibration of BayesCG under the Krylov prior, a probabil...
research
01/04/2021

A Block Bidiagonalization Method for Fixed-Precision Low-Rank Matrix Approximation

We present randUBV, a randomized algorithm for matrix sketching based on...
research
11/09/2022

Efficient Bounds and Estimates for Canonical Angles in Randomized Subspace Approximations

Randomized subspace approximation with "matrix sketching" is an effectiv...
research
08/18/2023

Minimaxity under half-Cauchy type priors

This is a follow-up paper of Polson and Scott (2012, Bayesian Analysis),...
research
07/25/2023

A flexible class of priors for conducting posterior inference on structured orthonormal matrices

The big data era of science and technology motivates statistical modelin...
research
01/11/2018

Estimation of the Robin coefficient field in a Poisson problem with uncertain conductivity field

We consider the reconstruction of a heterogeneous coefficient field in a...
research
01/16/2018

A Bayesian Conjugate Gradient Method

A fundamental task in numerical computation is the solution of large lin...

Please sign up or login with your details

Forgot password? Click here to reset