Nonlinear state-space identification using deep encoder networks

by   Gerben Beintema, et al.

Nonlinear state-space identification for dynamical systems is most often performed by minimizing the simulation error to reduce the effect of model errors. This optimization problem becomes computationally expensive for large datasets. Moreover, the problem is also strongly non-convex, often leading to sub-optimal parameter estimates. This paper introduces a method that approximates the simulation loss by splitting the data set into multiple independent sections similar to the multiple shooting method. This splitting operation allows for the use of stochastic gradient optimization methods which scale well with data set size and has a smoothing effect on the non-convex cost function. The main contribution of this paper is the introduction of an encoder function to estimate the initial state at the start of each section. The encoder function estimates the initial states using a feed-forward neural network starting from historical input and output samples. The efficiency and performance of the proposed state-space encoder method is illustrated on two well-known benchmarks where, for instance, the method achieves the lowest known simulation error on the Wiener–Hammerstein benchmark.



There are no comments yet.


page 1

page 2

page 3

page 4


Non-linear State-space Model Identification from Video Data using Deep Encoders

Identifying systems with high-dimensional inputs and outputs, such as sy...

Deep Identification of Nonlinear Systems in Koopman Form

The present paper treats the identification of nonlinear dynamical syste...

Deep subspace encoders for continuous-time state-space identification

Continuous-time (CT) models have shown an improved sample efficiency dur...

Improved Initialization of State-Space Artificial Neural Networks

The identification of black-box nonlinear state-space models requires a ...

Identification of LTV Dynamical Models with Smooth or Discontinuous Time Evolution by means of Convex Optimization

We establish a connection between trend filtering and system identificat...

Enhanced Particle Swarm Optimization Algorithms for Multiple-Input Multiple-Output System Modelling using Convolved Gaussian Process Models

Convolved Gaussian Process (CGP) is able to capture the correlations not...

Model structures and fitting criteria for system identification with neural networks

This paper focuses on the identification of dynamical systems with tailo...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.