Variational Nonlinear System Identification

12/08/2020
by   Jarrad Courts, et al.
0

This paper considers parameter estimation for nonlinear state-space models, which is an important but challenging problem. We address this challenge by employing a variational inference (VI) approach, which is a principled method that has deep connections to maximum likelihood estimation. This VI approach ultimately provides estimates of the model as solutions to an optimisation problem, which is deterministic, tractable and can be solved using standard optimisation tools. A specialisation of this approach for systems with additive Gaussian noise is also detailed. The proposed method is examined numerically on a range of simulation and real examples with a focus on robustness to parameter initialisations; we additionally perform favourable comparisons against state-of-the-art alternatives.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/07/2020

Constructing a variational family for nonlinear state-space models

We consider the problem of maximum likelihood parameter estimation for n...
research
12/14/2020

Variational State and Parameter Estimation

This paper considers the problem of computing Bayesian estimates of both...
research
02/12/2015

Newton-based maximum likelihood estimation in nonlinear state space models

Maximum likelihood (ML) estimation using Newton's method in nonlinear st...
research
05/12/2022

Generalized Variational Inference in Function Spaces: Gaussian Measures meet Bayesian Deep Learning

We develop a framework for generalized variational inference in infinite...
research
06/01/2022

Amortized backward variational inference in nonlinear state-space models

We consider the problem of state estimation in general state-space model...
research
11/25/2021

Variational Gibbs inference for statistical model estimation from incomplete data

Statistical models are central to machine learning with broad applicabil...
research
05/02/2019

On the Smoothness of Nonlinear System Identification

New light is shed onto optimization problems resulting from prediction e...

Please sign up or login with your details

Forgot password? Click here to reset