Probabilistic Linear Solvers: A Unifying View

by   Simon Bartels, et al.

Several recent works have developed a new, probabilistic interpretation for numerical algorithms solving linear systems in which the solution is inferred in a Bayesian framework, either directly or by inferring the unknown action of the matrix inverse. These approaches have typically focused on replicating the behavior of the conjugate gradient method as a prototypical iterative method. In this work surprisingly general conditions for equivalence of these disparate methods are presented. We also describe connections between probabilistic linear solvers and projection methods for linear systems, providing a probabilistic interpretation of a far more general class of iterative methods. In particular, this provides such an interpretation of the generalised minimum residual method. A probabilistic view of preconditioning is also introduced. These developments unify the literature on probabilistic linear solvers, and provide foundational connections to the literature on iterative solvers for linear systems.


page 1

page 2

page 3

page 4


Probabilistic Linear Solvers for Machine Learning

Linear systems are the bedrock of virtually all numerical computation. M...

Probabilistic Interpretation of Linear Solvers

This manuscript proposes a probabilistic framework for algorithms that i...

Residual Tracking and Stopping for Iterative Random Sketching

Iterative random sketching (IRS) offers a computationally expedient appr...

Contributed Discussion of "A Bayesian Conjugate Gradient Method"

We would like to congratulate the authors of "A Bayesian Conjugate Gradi...

Convergence of Adaptive, Randomized, Iterative Linear Solvers

Deterministic and randomized, row-action and column-action linear solver...

On variational iterative methods for semilinear problems

This paper presents an iterative method suitable for inverting semilinea...

Constraint-Preconditioned Krylov Solvers for Regularized Saddle-Point Systems

We consider the iterative solution of regularized saddle-point systems. ...