Improved Initialization of State-Space Artificial Neural Networks

by   Maarten Schoukens, et al.

The identification of black-box nonlinear state-space models requires a flexible representation of the state and output equation. Artificial neural networks have proven to provide such a representation. However, as in many identification problems, a nonlinear optimization problem needs to be solved to obtain the model parameters (layer weights and biases). A well-thought initialization of these model parameters can often avoid that the nonlinear optimization algorithm converges to a poorly performing local minimum of the considered cost function. This paper introduces an improved initialization approach for nonlinear state-space models represented as a recurrent artificial neural network and emphasizes the importance of including an explicit linear term in the model structure. Some of the neural network weights are initialized starting from a linear approximation of the nonlinear system, while others are initialized using random values or zeros. The effectiveness of the proposed initialization approach over previously proposed methods is illustrated on two benchmark examples.



There are no comments yet.


page 5

page 6


Deep State Space Models for Nonlinear System Identification

An actively evolving model class for generative temporal models develope...

Nonlinear state-space identification using deep encoder networks

Nonlinear state-space identification for dynamical systems is most often...

Distributed Identification of Contracting and/or Monotone Network Dynamics

This paper proposes methods for identification of large-scale networked ...

System identification of biophysical neuronal models

After sixty years of quantitative biophysical modeling of neurons, the i...

Estimation for Compositional Data using Measurements from Nonlinear Systems using Artificial Neural Networks

Our objective is to estimate the unknown compositional input from its ou...

Deep Identification of Nonlinear Systems in Koopman Form

The present paper treats the identification of nonlinear dynamical syste...

Training Recurrent Neural Networks as a Constraint Satisfaction Problem

This paper presents a new approach for training artificial neural networ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.