Log In Sign Up

Mean-Field Variational Inference for Gradient Matching with Gaussian Processes

by   Nico S. Gorbach, et al.

Gradient matching with Gaussian processes is a promising tool for learning parameters of ordinary differential equations (ODE's). The essence of gradient matching is to model the prior over state variables as a Gaussian process which implies that the joint distribution given the ODE's and GP kernels is also Gaussian distributed. The state-derivatives are integrated out analytically since they are modelled as latent variables. However, the state variables themselves are also latent variables because they are contaminated by noise. Previous work sampled the state variables since integrating them out is not analytically tractable. In this paper we use mean-field approximation to establish tight variational lower bounds that decouple state variables and are therefore, in contrast to the integral over state variables, analytically tractable and even concave for a restricted family of ODE's, including nonlinear and periodic ODE's. Such variational lower bounds facilitate "hill climbing" to determine the maximum a posteriori estimate of ODE parameters. An additional advantage of our approach over sampling methods is the determination of a proxy to the intractable posterior distribution over state variables given observations and the ODE's.


page 1

page 2

page 3

page 4


Fast and Accurate Variational Inference for Models with Many Latent Variables

Models with a large number of latent variables are often used to fully u...

Deep Gaussian Processes with Importance-Weighted Variational Inference

Deep Gaussian processes (DGPs) can model complex marginal densities as w...

Beyond the Mean-Field: Structured Deep Gaussian Processes Improve the Predictive Uncertainties

Deep Gaussian Processes learn probabilistic data representations for sup...

Inferring Parsimonious Coupling Statistics in Nonlinear Dynamics with Variational Gaussian Processes

Nonparametetric methods of uncovering coupling provides a flexible frame...

Scalable Variational Inference for Dynamical Systems

Gradient matching is a promising tool for learning parameters and state ...

Point process simulation of Generalised inverse Gaussian processes and estimation of the Jaeger Integral

In this paper novel simulation methods are provided for the Generalised ...

Physics Regularized Gaussian Processes

We consider incorporating incomplete physics knowledge, expressed as dif...