Newton-based maximum likelihood estimation in nonlinear state space models

02/12/2015
by   Manon Kok, et al.
0

Maximum likelihood (ML) estimation using Newton's method in nonlinear state space models (SSMs) is a challenging problem due to the analytical intractability of the log-likelihood and its gradient and Hessian. We estimate the gradient and Hessian using Fisher's identity in combination with a smoothing algorithm. We explore two approximations of the log-likelihood and of the solution of the smoothing problem. The first is a linearization approximation which is computationally cheap, but the accuracy typically varies between models. The second is a sampling approximation which is asymptotically valid for any SSM but is more computationally costly. We demonstrate our approach for ML parameter estimation on simulated data from two different SSMs with encouraging results.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/19/2020

Computation of the Gradient and the Hessian of the Log-likelihood of the State-space Model by the Kalman Filter

The maximum likelihood estimates of an ARMA model can be obtained by the...
research
04/18/2017

Maximum Likelihood Estimation based on Random Subspace EDA: Application to Extrasolar Planet Detection

This paper addresses maximum likelihood (ML) estimation based model fitt...
research
06/25/2018

Accelerating likelihood optimization for ICA on real signals

We study optimization methods for solving the maximum likelihood formula...
research
09/29/2022

Mixed-effects location-scale model based on generalized hyperbolic distribution

Motivated by better modeling of intra-individual variability in longitud...
research
12/08/2020

Variational Nonlinear System Identification

This paper considers parameter estimation for nonlinear state-space mode...
research
08/27/2020

Efficient closed-form estimation of large spatial autoregressions

Newton-step approximations to pseudo maximum likelihood estimates of spa...
research
10/25/2018

Efficient Learning of Restricted Boltzmann Machines Using Covariance estimates

Learning of RBMs using standard algorithms such as CD(k) involves gradie...

Please sign up or login with your details

Forgot password? Click here to reset