Differentiable Likelihoods for Fast Inversion of 'Likelihood-Free' Dynamical Systems

02/21/2020
by   Hans Kersting, et al.
0

Likelihood-free (a.k.a. simulation-based) inference problems are inverse problems with expensive, or intractable, forward models. ODE inverse problems are commonly treated as likelihood-free, as their forward map has to be numerically approximated by an ODE solver. This, however, is not a fundamental constraint but just a lack of functionality in classic ODE solvers, which do not return a likelihood but a point estimate. To address this shortcoming, we employ Gaussian ODE filtering (a probabilistic numerical method for ODEs) to construct a local Gaussian approximation to the likelihood. This approximation yields tractable estimators for the gradient and Hessian of the (log-)likelihood. Insertion of these estimators into existing gradient-based optimization and sampling methods engenders new solvers for ODE inverse problems. We demonstrate that these methods outperform standard likelihood-free approaches on three benchmark-systems.

READ FULL TEXT
research
12/15/2017

Random forward models and log-likelihoods in Bayesian inverse problems

We consider the use of randomised forward models and log-likelihoods wit...
research
01/28/2022

Generalized statistics: applications to data inverse problems with outlier-resistance

The conventional approach to data-driven inversion framework is based on...
research
07/02/2018

Certified dimension reduction in nonlinear Bayesian inverse problems

We propose a dimension reduction technique for Bayesian inverse problems...
research
12/02/2018

Ensemble-based implicit sampling for Bayesian inverse problems with non-Gaussian priors

In the paper, we develop an ensemble-based implicit sampling method for ...
research
04/19/2023

Analysis of a Computational Framework for Bayesian Inverse Problems: Ensemble Kalman Updates and MAP Estimators Under Mesh Refinement

This paper analyzes a popular computational framework to solve infinite-...
research
04/28/2022

Multilevel Optimization for Inverse Problems

Inverse problems occur in a variety of parameter identification tasks in...

Please sign up or login with your details

Forgot password? Click here to reset