Statistical Properties of the Probabilistic Numeric Linear Solver BayesCG

08/08/2022
by   Tim W. Reid, et al.
0

We analyse the calibration of BayesCG under the Krylov prior, a probabilistic numeric extension of the Conjugate Gradient (CG) method for solving systems of linear equations with symmetric positive definite coefficient matrix. Calibration refers to the statistical quality of the posterior covariances produced by a solver. Since BayesCG is not calibrated in the strict existing notion, we propose instead two test statistics that are necessary but not sufficient for calibration: the Z-statistic and the new S-statistic. We show analytically and experimentally that under low-rank approximate Krylov posteriors, BayesCG exhibits desirable properties of a calibrated solver, is only slightly optimistic, and is computationally competitive with CG.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/17/2023

Properties of the ENCE and other MAD-based calibration metrics

The Expected Normalized Calibration Error (ENCE) is a popular calibratio...
research
08/07/2020

A Probabilistic Numerical Extension of the Conjugate Gradient Method

We present a Conjugate Gradient (CG) implementation of the probabilistic...
research
10/24/2019

Calibration tests in multi-class classification: A unifying framework

In safety-critical applications a probabilistic model is usually require...
research
06/09/2023

The effect of approximate coarsest-level solves on the convergence of multigrid V-cycle methods

The multigrid V-cycle method is a popular method for solving systems of ...
research
05/15/2021

Calibrating sufficiently

When probabilistic classifiers are trained and calibrated, the so-called...
research
07/22/2020

An Adaptive Solver for Systems of Linear Equations

Computational implementations for solving systems of linear equations of...
research
07/08/2020

Learning from DPPs via Sampling: Beyond HKPV and symmetry

Determinantal point processes (DPPs) have become a significant tool for ...

Please sign up or login with your details

Forgot password? Click here to reset