Bayesian ODE Solvers: The Maximum A Posteriori Estimate

by   Filip Tronarp, et al.

It has recently been established that the numerical solution of ordinary differential equations can be posed as a nonlinear Bayesian inference problem, which can be approximately solved via Gaussian filtering and smoothing, whenever a Gauss–Markov prior is used. In this paper the class of ν times differentiable linear time invariant Gauss–Markov priors is considered. A taxonomy of Gaussian estimators is established, with the maximum a posteriori estimate at the top of the hierarchy, which can be computed with the iterated extended Kalman smoother. The remaining three classes are termed explicit, semi-implicit, and implicit, which are in similarity with the classical notions corresponding to conditions on the vector field, under which the filter update produces a local maximum a posteriori estimate. The maximum a posteriori estimate corresponds to an optimal interpolant in the reproducing Hilbert space associated with the prior, which in the present case is equivalent to a Sobolev space of smoothness ν+1. Consequently, using methods from scattered data approximation and nonlinear analysis in Sobolev spaces, it is shown that the maximum a posteriori estimate converges to the true solution at a polynomial rate in the fill-distance (maximum step size) subject to mild conditions on the vector field. The methodology developed provides a novel and more natural approach to study the convergence of these estimators than classical methods of convergence analysis. The methods and theoretical results are demonstrated in numerical examples.


page 1

page 2

page 3

page 4


Maximum a posteriori estimators in ℓ^p are well-defined for diagonal Gaussian priors

We prove that maximum a posteriori estimators are well-defined for diago...

Strong maximum a posteriori estimation in Banach spaces with Gaussian priors

This article shows that a large class of posterior measures that are abs...

Bayesian Filtering for ODEs with Bounded Derivatives

Recently there has been increasing interest in probabilistic solvers for...

The Viterbi process, decay-convexity and parallelized maximum a-posteriori estimation

The Viterbi process is the limiting maximum a-posteriori estimate of the...

A priori and a posteriori error analysis for the Nitsche's method of a reduced Landau-de Gennes problem

The equilibrium configurations of a two dimensional planar bistable nema...

LS-SVR as a Bayesian RBF network

We show the theoretical equivalence between the Least Squares Support Ve...

Nonparametric statistical inference for drift vector fields of multi-dimensional diffusions

The problem of determining a periodic Lipschitz vector field b=(b_1, ......

Please sign up or login with your details

Forgot password? Click here to reset