Probabilistic Iterative Methods for Linear Systems

12/23/2020
by   Jon Cockayne, et al.
0

This paper presents a probabilistic perspective on iterative methods for approximating the solution 𝐱_* ∈ℝ^d of a nonsingular linear system 𝐀𝐱_* = 𝐛. In the approach a standard iterative method on ℝ^d is lifted to act on the space of probability distributions 𝒫(ℝ^d). Classically, an iterative method produces a sequence 𝐱_m of approximations that converge to 𝐱_*. The output of the iterative methods proposed in this paper is, instead, a sequence of probability distributions μ_m ∈𝒫(ℝ^d). The distributional output both provides a "best guess" for 𝐱_*, for example as the mean of μ_m, and also probabilistic uncertainty quantification for the value of 𝐱_* when it has not been exactly determined. Theoretical analysis is provided in the prototypical case of a stationary linear iterative method. In this setting we characterise both the rate of contraction of μ_m to an atomic measure on 𝐱_* and the nature of the uncertainty quantification being provided. We conclude with an empirical illustration that highlights the insight into solution uncertainty that can be provided by probabilistic iterative methods.

READ FULL TEXT

page 25

page 26

research
12/05/2018

Empirical priors and coverage of posterior credible sets in a sparse normal mean model

Bayesian methods provide a natural means for uncertainty quantification,...
research
11/06/2022

Recent Advances in Uncertainty Quantification Methods for Engineering Problems

In the last few decades, uncertainty quantification (UQ) methods have be...
research
05/30/2023

Probabilistic Computation with Emerging Covariance: Towards Efficient Uncertainty Quantification

Building robust, interpretable, and secure artificial intelligence syste...
research
05/01/2023

Proper Scoring Rules for Survival Analysis

Survival analysis is the problem of estimating probability distributions...
research
07/24/2023

Model-free generalized fiducial inference

Motivated by the need for the development of safe and reliable methods f...
research
03/18/2021

Decision Theoretic Bootstrapping

The design and testing of supervised machine learning models combine two...

Please sign up or login with your details

Forgot password? Click here to reset