Laplace-aided variational inference for differential equation models

04/07/2021
by   Hyunjoo Yang, et al.
0

Ordinary differential equation (ODE) model whose regression curves are a set of solution curves for some ODEs, poses a challenge in parameter estimation. The challenge due to the frequent absence of analytic solutions and the complicated likelihood surface, tends to be more severe especially for larger models with many parameters and variables. Yang and Lee (2020) proposed state-space model with variational Bayes (SSVB) for ODE, capable of fast and stable estimation in somewhat large ODE models. The method has shown excellent performance in parameter estimation but has a weakness of underestimation of the posterior covariance, which originates from the mean-field variational method. This paper proposes a way to overcome the weakness, by using the Laplace approximation. In numerical experiments, the covariance modified by the Laplace approximation showed a high degree of improvement when checked against the covariances obtained by a standard Markov chain Monte Carlo method. With the improved covariance estimation, the SSVB renders fairly accurate posterior approximations.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 10

page 13

11/19/2020

Variational Bayes method for ODE parameter estimation with application to time-varying SIR model for Covid-19 epidemic

Ordinary differential equation (ODE) is a mathematical model for dynamic...
11/13/2017

Incremental Mixture Importance Sampling with Shotgun optimization

This paper proposes a general optimization strategy, which combines resu...
04/21/2020

INLA-MRA: A Bayesian method for large spatiotemporal datasets

Large spatiotemporal datasets are a challenge for conventional Bayesian ...
10/24/2014

Covariance Matrices for Mean Field Variational Bayes

Mean Field Variational Bayes (MFVB) is a popular posterior approximation...
01/14/2021

Bayesian inference with tmbstan for a state-space model with VAR(1) state equation

When using R package tmbstan for Bayesian inference, the built-in featur...
02/26/2015

Covariance Matrices and Influence Scores for Mean Field Variational Bayes

Mean field variational Bayes (MFVB) is a popular posterior approximation...
11/25/2021

Correcting the Laplace Method with Variational Bayes

Approximate inference methods like the Laplace method, Laplace approxima...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.